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PREFACE 


This  handbook  provides  COMOPTEVFOR  with  a reference  source  of 
measures  of  effectiveness  (MOE's)  used  In  Naval  warfare  and  previous  OPTEVFOR 
projects.  In  particular,  this  reference  handbook  provides  assistance  to 
Project  Officers  and  Analysts  In  the  preparation  of  a TEMP,  Evaluation  Plan 
or  Test  Plan,  and  as  an  aid: 

(1)  In  the  selection  of  measures  of  effectiveness 

(2)  In  the  corresponding  selection  of  test  objectives 

(3)  In  the  Identification  of  data  requirements 

(4)  In  the  conduct  of  project  operations 

(5)  In  the  determination  of  data  analysis  techniques  to  be  used. 

The  Information  presented  in  this  handbook  Is  based  on  a compre- 
hensive review  of  OPTEVFOR  reports.  Specifically,  a summary  Is  presented 
of  MOE's  used  In  Development  Assists,  Operational  Assists,  Operational 
Appraisals,  Technical  Evaluations,  Operational  Evaluations,  Concurrent 
Evaluations,  Fleet  Research  Investigations  and  Fleet  Operational  Investi- 
gations. For  each  report  the  platform,  system  or  subsystem  considered  is 
briefly  described  together  with  the  specific  test,  evaluation,  or  appraisal 
objectives,  the  MOE's  selected,  an4  the  corresponding  MOE  data  requirements. 

The  scope  of  the  handbook  Is  limited  to  effectiveness  measures 
only.  Materiel  reliability  and  human  factor  measures  are  not  Included. 

Even  in  the  effectiveness  measure  area  the  coverage  Is  not  complete  - It 
was  not  Intended  to  be.  It  Is  expected  that  continuous  update  will  be 
performed. 

This  handbook  Is  FOR  GUIDANCE  ONLY  and  is  not  Intended  to  be  the 
only  source  of  Information  to  be  used  by  Project  Officers  or  Analysts  In 
the  selection  of  measures  of  effectiveness. 
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INTRODUCTION 


COMOPTEVFOR  personnel  become  Involved  In  the  preparation  of  project 
plans  for  a broad  range  of  projects.  In  Operational  Assists  for  which  the 
purpose  is  to  gather  operational  data  in  a "quick  look"  effort  to  aid  In 
deciding  whether  a particular  course  of  development  is  worthy  of  pursuit, 
the  project  plan  Is  prepared  jointly  by  COMOPTEVFOR  and  the  Developing 
Agency,  but  the  execution  and  reporting  of  the  results  Is  accomplished  by 
COMOPTEVFOR.  In  Operational  Appraisals  relating  to  systems,  equipment  or 
components  In  fleet  use  which  have  not  undergone  operational  evaluation 
and/or  been  recommended  for  service  use,  COMOPTEVFOR  is  responsible  for  the 
planning  and  prosecution  of  the  project.  In  Operational  Evaluations  for 
which  the  purpose  is  to  determine  the  ability  of  the  system  or  equipment 
to  meet  operational  performance  requirements,  COMOPTEVFOR  prepares  the 
project  plan,  arranges  for  Fleet  support,  prosecutes  the  project,  and 
analyzes  and  reports  the  results.  COMOPTEVFOR  has  similar  project  respon- 
sibilities for  the  operational  phase  of  Concurrent  Evaluations. 

In  the  preparation  of  these  project  plans  the  overall  project 
objectives  must  be  defined  and  then  the  specific  objectives,  including 
success  criteria,  must  be  Identified.  An  integral  part  of  the  project  plan 
for  an  evaluation  will  be  the  definition  of  the  missions  or  operational  roles 
of  the  platforms,  systems,  subsystems  and  equipments  Involved.  The  success 
criteria  form  the  basis  for  determining  whether  or  not  the  missions  or  opera- 
tional roles  are  successful  as  reflected  in  whether  or  not  the  specific 
objectives  are  met.  To  quantify  this  determination  requires  the  use  of 
numerical  scores  or  statistical  estimates.  This  Is  the  role  played  by  the 
measure  of  effectiveness.  It  provides  the  quantification  of  how  well  the 
specific  objectives  are  met  such  as  how  successful  a platform  Is  In  accomplish 
1 ng  Its  mission  or  how  successful  a system,  subsystem  or  piece  of  equipment  is 
In  performing  its  operational  role  as  part  of  the  mission. 

The  selection  of  MOE's  Is  an  Important  step  in  this  preparation 
for  an  evaluation.  This  Is  because  MOE's  enable  the  Project  Officer  or 
Analyst  to  assess  whether  or  not,  or  how  well,  the  specific  test  objectives 
(chosen  to  test  or  verify  that  desired  operational  or  performance  goals  are 
met)  are  satisfied.  This  handbook  Is  designed  to  aid  the  Project  Officer  or 


Analyst  In  this  selection  process.  It  Is  not  Intended  to  be  an  all- 
inclusive,  or  exhaustive,  compendium  of  MOE's  such  that  the  Project 
Officer  or  Analyst  needs  only  turn  to  the  right  page  and  then  select 
his  MOE.  With  the  present  changes  In  the  test  and  evaluation  process, 
previously  used  MOE's  may  no  longer  be  appropriate  and,  even  though 
suggestive  of  the  types  of  measures  which  could  be  used,  are  In  many 
cases  Incomplete  by  today's  standards.  Not  only  Is  the  situation 
dynamic,  but  It  can  be  generally  stated  that  "every  project  Is  different". 
Consequently,  this  handbook  Is  not.  a cookbook,  but  serves  more  for  stimu- 
lation and  guidance  In  general  approaches  to  be  followed.  The  selection 
of  MOE's  and  the  corresponding  details  must  be  tailored  to  the  specific 
project. 

Figure  1.1  provides  an  Illustration  of  the  use  of  this  handbook 
by  a Project  Officer  or  Analyst.  Once  the  project  objectives,  the  specific 
objectives  for  test  and  evaluation,  the  platforms  Involved  and  the  level 
of  evaluation  are  defined,  the  Project  Officer  or  Analyst  Is  at  the  MOE 
selection  stage.  There  may  be  more  than  one  MOE  which  could  be  used  and, 
furthermore,  for  each  objective  or  set  of  objectives  there  may  be  a different 
MOE  which  Is  applicable.  The  Project  Officer  or  Analyst  Is  thus  faced  with 
having  to  make  this  selection.  It  Is  at  this  MOE  selection  stage  where  a 
Measure;,  of  Effectiveness  Handbook  can  be  of  the  greatest  value.  The  reason 
for  this  Is  that  such  a handbook  would  contain  a sumnary  of  MOE's  by  area(s) 
of  applicability,  criteria  (based  on  test  objectlve(s))  for  selection  when 
more  than  one  choice  of  a MOE  exists,  formulations  of  each  MOE,  an  identifi- 
cation of  data  requirements  for  computation,  and  a reference  to  previous 
usage  of  the  MOE.  Thus,  such  a document  would  provide  ready  access  to  infor- 
mation needed  by  the  Project  Officer  and  can  also  serve  as  a reference  source 
for  Analysts  In  the  design  of  test  plans  and  the  evaluation  of  systems. 

Figures  1.2  and  1.3  provide  Illustrations  In  ASW  of  typical  MOE's 
which  could  be  used  In  platform  level  and  system  level  evaluations,  respectively. 
As  can  be  seen,  at  the  platform  level  there  may  be  more  than  one  mission  for 
the  platform,  for  a given  mission  there  may  be  more  than  one  success  criterion, 
and  for  a given  success  criterion  there  may  be  more  than  one  MOE.  Similarly, 
for  a specified  system  operational  role  within  a platform  mission  there  may  be 


FIGURE  1.3  System  Level  Illustrative  MOE  Sumnary 


EXPECTED  DETECTION  RANGE 


more  than  one  success  criterion,  and  for  a given  success  criterion  there 
may  also  be  more  than  one  MOE.  Each  choice  of  the  MOE  could  be  expected 
to  lead  to  a special  set  of  data  requirements.  The  project  plan  would 
thus  have  to  Include  these  data  requirements  and  the  project  data  sheets 
would  have  to  be  structured  according  to  these  requirements.  The  analysis 
required  to  compute  these  MOE's  would  be  dependent  upon  the  complexity  of 
the  MOE  formulation  and  could  even  require  the  use  of  a digital  computer 
for  not  only  data  processing  and  reduction  but  perhaps  to  perform  mathe- 
matical simulations  of  portions  of  the  test  which  could  not  be  conducted 
at  sea. 

It  Is  Important  to  recognize  that  In  the  selection  of  an  MOE  one 
must  consider  the  tasks  that  the  platform,  system,  subsystem  or  equipment 
under  evaluation  has  to  perform.  Measures  of  effectiveness  can  also  be 
regarded  as  measures  of  how  well  these  tasks  are  done.  For  example,  in 
evaluating  the  detection  performance  of  a sensor,  the  MOE  may  be  the  prob- 
ability of  detection  as  a function  of  target  range,  or  In  evaluating  the 
kill  performance  of  a missile  warhead  the  MOE  may  be  the  probability  of 
target  kill  given  detonation.  In  many  cases  more  than  one  task  (say,  sub- 
task) comprise  a broader  task  such  as  to  achieve  overall  target  kill  It 
must  be  detected,  recognized  as  a valid  target,  acquired,  tracked,  fired 
at  with  a weapon  and  killed.  An  MOE  for  each  of  these  subtasks  Is  commonly 
referred  to  as  a "function  MOE"  since  It  provides  a measure  of  how  well  the 
Individual  subtask  (or  function  necessary  to  accomplish  the  broader  task)  Is 
accomplished.  Therefore,  an  MOE  for  the  broader  task  could  be  expected  to 
be  a function  of  these  suotask  or  function  MOE's.  This  Illustrates  the  type 
of  hierarchy  which  generally  exists  among  MOE's. 

As  the  MOE  hierarchy  evolves  from  the  top  level  to  the  lower  levels 
(such  as  from  force  level  to  platform  level  to  system  level  to  subsystem  or 
equipment  level),  the  nature  or  form  of  the  MOE  changes.  At  the  lower  levels, 
the  MOE's  become  less  "effectiveness  oriented"  and  more  "performance  oriented". 
For  «xample,  median  detection  range,  circular  error  probable,  mean  miss 
distance,  etc.  are  typical  performance  oriented  MOE  s,  whereas  expected  number 
of  target  kills  per  sortie,  probability  of  target  detection,  classification, 
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localization  and  kill,  and  the  exchange  ratio  given  by  the  ratio  of  enemy 
kills  to  friendly  kills  are  typical  effectiveness  oriented  MOE's  at  the 
platform  or  force  levels.  It  Is  Important  to  emphasize  that  the  selection 
of  MOE's  and  data  requirements  Is  not  a bottom-up  procedure  but  rather  a 
top-down  procedure;  that  Is,  a Project  Officer  or  Analyst  should  not  first 
look  up  MOE's  to  see  what  he  c«;n  calculate  and  then  let  this  drive  the  tests 
that  are  to  be  run.  He  should  focus  his  MOE  selection  effort  at  least  one 
evaluation  level  higher  than  that  called  for  In  the  test  or  evaluation,  and 
select  an  effectiveness  oriented  MOE  before  determining  the  performance 
oriented  MOE's  which  It  depends  upon. 

In  the  following  sections  are  presented  discussions  of  how  MOE's 
are  used  In  OPTEVFOR  projects  and  analyses,  guidance  in  the  selection  of 
these  MOE's,  the  hierarchy  that  exists  between  MOE's  at  various  levels  of 
evaluation,  MOE  data  formulations,  and  how  to  use  the  MOE  data  base  provided 
In  Appendix  B of  this  handbook.  This  data  base  Is  Intended  to  be  Illustrative 
of  the  types  of  MOE's  that  have  been  used  In  the  past  and  are  thus  potential 
candidates  for  use  now  or  In  the  future,  however  the  Project  Officer  or 
Analyst  should  be  aware  of  the  caveat,  namely,  what  was  used  In  the  past 
(be  It  right  or  wrong)  Is  not  necessarily  what  should  be  used  now  or  in 
the  future.  The  Project  Officer  or  Analyst  should  use  this  data  base  as  a 
starting  point  not  as  an  ending  point  in  the  selection  of  the  MOE's  most 
appropriate  for  his  particular  test  or  evaluation.  As  new  MOE's  are  created 
and  formulated,  they  can  be  readily  added  to  the  data  base,  thus  providing 
an  up  to  date  MOE  reference  source. 

2.0  GUIDELINES  AND  CRITERIA  FOR  MOE  SELECTION 

The  Importance  of  choosing  the  right  MOE  Is  Illustrated  by  a 
classic  example  offered  by  Morse  and  Kimball.*  During  World  War  II, 

British  merchant  ships  in  the  Mediterranean  were  provided  with  anti- 
aircraft guns  to  protect  them  against  German  dive  bombers.  After  several 
months  of  operation,  an  effectiveness  evaluation  was  made  which  showed 
that  the  enemy  aircraft  was  shot  down  in  only  about  four  percent  of  the 


Philip  M.  Morse  and  George  E.  Kimball,  Methods  of  Operations  Research. 
John  Wiley  and  Sons,  New  York,  1951 


attacks.  On  this  basis,  It  was  tentatively  decided  to  remove  the  guns, 
which  were  relatively  expensive  and  needed  elsewhere.  It  was  then  pointed 
out  that  the  wrong  MOE  had  been  used  In  the  evaluation.  The  real  objective 
was  to  protect  the  merchant  vessels,  not  necessarily  to  destroy  enemy 
aircraft,  which  could  be  done  more  efficiently  In  other  ways.  If  the  guns 
caused  the  aircraft  to  stay  at  high  altitude  or  forced  them  to  maneuver 
evasively,  thus  degrading  the  bombing  accuracy,  they  would  have  served 
their  purpose.  When  the  MOE  was  framed  In  terms  of  the  proper  objective, 

It  was  found  that  only  ten  percent  of  the  protected  ships  had  been  sunk 
when  attacked,  compared  with  twenty-five  percent  for  the  unprotected 
ships.  Based  on  these  facts,  the  guns  were  left  on  the  ships. 

A similar  type  of  situation  occurred  more  recently  in  the  Viet 
Nam  War  when  the  SHRIKE  antiradiation  missile  was  introduced.  This  missile 
was  designed  to  home-on  and  to  destroy  radars.  When  It  was  first  used, 
the  missile  was  very  successful  in  destroying  radars;  however,  the  enemy 
soon  learned  that  by  shutting  off  or  intermittently  using  their  radars 
they  could  defeat  the  missile.  Consequently,  choosing  the  missile  MOE 
as  the  probability  of  radar  kill,  we  have  a case  where  the  Initially  observed 
values  of  this  MOE  were  high,  but  decreased  with  time  and  continued  use  of 
the  missile.  The  problem  here  is  one  of  choosing  the  wrong  MOE.  In  reality, 
the  purpose  of  the  missile  was  to  Increase  the  survivability  of  penetrating 
strike  aircraft  by  suppressing  enemy  radar  transmissions  or  causing  the 
enemy  radars  to  cease  radiating;  hence  no  surface-to-air  missiles  could 
be  fired.  This  objective  can  be  accomplished  In  several  ways,  namely: 

(1)  the  missile  can  physically  destroy  the  radar  as  It  Is  designed 
to  do; 

(2)  the  missile  can  be  fired  at  the  radar  target,  and  if  the  radar 
operator  is  aware  that  the  missile  has  been  launched  at  him, 
he  may  shut  the  radar  off  the  air  rather  than  risk  being 
destroyed ; 

(3)  the  mission  can  be  accomplished  if  the  pilot  turns  the  air- 
craft carrying  the  antiradiation  missile  toward  the  target, 
preparing  for  or  feigning  a missile  launch,  and  then  the 
radar  operator,  anticipating  a missile  attack,  shuts  down. 


Consequently,  the  mission  objective  can  be  accomplished  without  firing  any 
missiles  at  all.  In  the  case  of  strike  warfare  where  the  antiradiation 
missile  Is  employed  to  protect  penetrating  aircraft,  a candidate  measure  of 
effectiveness  would  be  the  probability  that  either  no  surface-to-air  missiles 
are  fired  or,  given  that  at  least  one  SAM  Is  fired,  all  aircraft  survive. 

In  addition  to  showing  that  a completely  wrong  decision  can  be 
forced  by  an  Injudicious  choice  of  criterion,  the  above  examples  serve  to 
Illustrate  an  Important  principle  of  criteria  selection:  the  criteria  must 

reflect  the  user's  objectives  at  the  appropriate  level  of  generality.  A 
further  observation  regarding  these  two  examples  Is  that  depending  on 
whether  or  not  your  choice  Is  the  offensive  or  defensive  role,  the  corre- 
sponding MOE's  are  different. 

Basic  guidance  In  the  selection  of  an  MOE  and  success  criteria  for 
the  evaluation  of  a platform,  system,  subsystem  or  piece  of  equipment  can 
generally  be  found  by  referring  to  the  principal  documents  In  the  RDT&E 
Planning  and  Acquisition  Process  - specifically,  GOR's,  TSOR's,  PTA's,  SOR's 
and  TDP's  for  on-going  programs,  and  CPPG's,  CPAM's,  STO's,  OR's,  TLR's  and 
US's  for  new  and  future  programs. 

General  Operational  Requirements  (GOR's)  forecast  operational 
capability  requirements,  Tentative  Specific  Operational  Requirements  (TSOR's) 
Identify  specific  operational  needs  and  the  required  capabilities  to  satisfy 
those  needs.  Proposed  Technical  Approaches  (PTA's)  specify  alternative 
approaches  to  attain  the  stated  needs,  Specific  Operational  Requirements  (SOR's) 
formally  state  the  need  for  development  of  new  or  improved  capabilities,  and 
Technical  Development  Plans  (TDP's)  document  the  actions,  procedures  and 
resources  required  to  achieve  the  capability  stated  In  the  SOR's.  For 
example,  GOR-11  Air  Strike  Warfare  states  that  In  assessing  capability  to 
perform  the  Defense  Suppression  Mission  one  must  recognize  that  the  objec- 
tive Is  to  help  minimize  overall  strike  force  attrition  by  using  escorts  to 
protect  against  surface  and  airborne  defenses;  hence,  in  this  case,  the 
success  criterion  Is  based  on  the  requirement  that  the  defenses  do  not 
fire,  or  are  relatively  Ineffective  in  their  fire,  during  the  attack  by 
the  primary  strike  force  and  thus  suppression  Is  successful  if  the  enemy 
defensive  systems  are  unable  to  effectively  Impede  the  primary  mission. 
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The  corresponding  SOR's  and  TOP'S  then  address  the  specific  types  of 
weapon  systems  and  development  plans,  respectively,  In  order  to  meet  fore- 
casted operational  capability  requirements  for  the  performance  of  this 
mission  against  future  anticipated  threats. 

In  the  case  of  many  new  and  all  future  programs,  potential  sources 
of  Information  on  missions,  operational  roles,  success  and  performance 
criteria,  and  test  objectives  are  of  various  types.  The  CNO  Planning 
Programming  Guidance  (CPPG)  document  describes  Navy  roles  and  missions, 
and  furnishes  broad  Navy  planning  guidance.  CNO  Program  Analysis  Memoranda 
(CPAM)  treat  mission  and  support  areas  In  terms  of  cost  and  capabilities, 
and  furnish  the  basis  for  consideration  of  broad  program  alternatives. 
Science  and  Technology  Objectives  (STO's),  as  part  of  the  Research  and 
Development  Plan,  describe  In  broad  terms  the  Navy  role  and  objectives 
anticipated  In  the  particular  warfare  area  In  the  10-20  year  future  time 
frame,  and  describe  the  threat  that  the  Navy  anticipates  encountering 
together  with  the  needed  capabilities  to  neutralize  or  overcome  this  threat 
In  this  time  frame.  Operational  Requirements  (OR's)  have  the  purpose  of 
establishing  the  parameters  for  the  concept  or  system  envisioned  and  contain 
the  following:  a brief  concise  statement  of  opposition  forces,  time  frame 

and  the  expected  parameters  of  the  threat  or  threat  system;  performance 
criteria;  performance  goals  for  the  Intended  mission;  statement  of  an 
achievable  level  of  performance  below  which  the  development  will  not  be 
acceptable;  description  of  the  natural  and  opposition  environment;  statement 
of  where,  how  and  under  what  environmental  conditions  the  capability  will 
be  employed.  The  Top  Level  Requirements  (TLR)  document  Is  basically  a ship 
acquisition  document  which  establishes  a requirements -capability  baseline 
and  describes  the  combat  tasks  and  functions  the  ship  Is  Intended  to  perform 
in  the  defined  mission  areas.  The  Top  Level  Specifications  (TLS)  document 
translates  the  TLR  document  Into  a physical  ship  description. 

Once  the  overall  project  and  specific  objectives  have  been  defined, 
the  types  of  platforms,  systems,  subsystems  and  equipments  to  be  evaluated 
or  appraised  must  be  Identified,  the  level  of  evaluation  (such  as  platform, 
system  or  subsystem)  defined,  and  the  operational  situations  for  evaluation 
or  appraisal  described.  For  example,  the  warfare  area  of  Interest  might  be 
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Airborne  ASW  and  the  operational  situation  that  of  contact  Investigation  at 
the  system  level  using  a helicopter  platform  equipped  with  dipping  sonar 
and  torpedoes.  At  this  point  In  the  project  plan  preparation  process,  a 
decision  must  be  made  as  to  what  measures  of  effectiveness  should  be  employed. 
In  this  example,  some  of  the  choices  are:  (1)  detection  sweep  width  (In  nm.) 
at  a prescribed  probability  of  detection,  (2)  probability  of  classification 
given  detection,  (3)  probability  of  localization  given  classification  and 
detection,  and  (4)  probability  of  target  kill  given  localization.  The 
Project  Officer  Is  thus  confronted  with  having  to  make  a choice  from  amongst 
one  or  more  possibilities,  each  of  which  may  appear  to  be  equally  as  good 
as  any  other.  If  the  specific  objective  Is  assessment  of  detection 
capability,  then  (1)  is  most  appropriate,  whereas  for  the  specific 
objectives  of  classification,  localization  and  kill  measures  (2),  (3) 
and  (4)  are  the  most  appropriate,  respectively.  A further  consideration 
Is  that  each  MOE  would  typically  have  Its  own  special  data  requirements 
and  data  formulation. 

Tables  2.1  -2.3  provide  a further  Illustration  of  the  fact  that 
for  a given  specific  objective  there  generally  exists  more  than  one  choice 
of  an  MOE,  each  with  Its  own  special  data  requirements  and  formulation, 
for  the  case  of  communications  systems,  ECM  systems,  and  radar  systems, 
respectively. 

Generally,  the  choice  of  an  MOE  to  be  used  In  the  evaluation  of 
any  platform,  system,  subsystem  or  piece  of  equipment  must  meet  basic 
requirements  such  as: 

(1)  It  must  directly  relate  to  how  well  the  specific  objective 
Is  met. 

(2)  It  should  be  relevant  to  the  mission  or  operational  role  of 
Interest. 

(3)  It  should  be  precisely  defined  and  expressed  In  terms  meaning- 
ful  to  the  decision  maker  In  order  to  prevent  decision  makers 
and  others  from  misunderstanding  the  implications  of  the  MOE. 

(4)  It  must  be  capable  of  exact  quantitative  definition  in  terms 
of  Inputs  that  are  measurable.  If  the  Inputs  are  not  measure- 
able,  the  MOE  cannot  be  evaluated. 
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Median  detection  range  for  Range  such  that  501  of  the  observed 

given  radar  mode,  target  detections  occurred  beyond  this 

type  and  target  altitude  range 
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(5)  It  must  be  feasible  to  measure  or  calculate. 

(6)  It  should  have  exhaustive  Inputs  and  be  sensitive  to  all 
variables  and  factors  affecting  the  Item  ( 1 . e . , platform, 
system,  subsystem  or  equipment).  By  this  It  Is  meant  that 
anything  that  affects  the  item's  effectiveness  should  appear 
as  an  Input  to  the  MOE  In  some  fashion.  This  assures  that  all 
aspects  that  can  affect  the  Item's  effectiveness  are  Included 
in  the  Inputs. 

(7)  It,  as  well  as  Its  Inputs,  should  be  mutually  exclusive  In 
the  sense  that  no  aspect  should  be  "counted"  more  than  once. 

A final  convnent  Is  that  It  Is  nearly  Impossible  to  compare  a new 
system  with  an  old  one  when  different  MOE's  are  being  used.  When  the  quality 
of  the  data  gathered  Is  not  changing  rapidly,  using  standard  MOE's  for  old 
and  new  systems  will  make  It  easier  to  compare  them  as  long  as  the  test 
conditions  are  the  same.  Making  a comparison  using  the  same  MOE  under 
differing  test  conditions  can  (and  most  probably  would)  lead  to  an  Invalid 
conclusion. 

3.0  MOE  HIERARCHY  APPROACH 

Measures  of  effectiveness  vary  In  structure  and  In  formulation 
according  to  the  level  of  the  evaluation  desired.  To  Illustrate  this, 
consider  the  area  of  Naval  gunfire  support.  Here  measures  of  effective- 
ness may  be  broadly  categorized  Into  those  applied  to  Individual  weapons, 
those  used  to  compare  two  tjpes  of  ships,  and  those  computed  for  entire 
fire  support  forces  In  specific  scenarios  and  special  situations.  At 
the  lowest  level  are  those  that  apply  to  a single  tube  of  a gun  battery 
or  a single  round.  In  this  case,  measures  of  effectiveness  are  the 
accuracy  and  range  of  the  gun,  Its  Tiring  rate,  and  the  expected  number 
of  rounds  required  to  achieve  some  specified  damage  or  casualty  level 
to  a particular  type  of  target.  A first  higher  level  measure  of  effective- 
ness Is  the  amount  of  time  a battery  must  fire  to  achieve  specified  damage 
or  casualty  levels  against  a representative  spectrum  of  targets  at  various 
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ranges.  A second  higher  order  measure  of  effectiveness  Is  the  percentage 
of  a ship's  ammunition  of  a given  type  that  must  be  expended  In  order  to 
accomplish  the  desired  results  against  representative  targets  at  various 
ranges.  At  a still  higher  level  of  sophistication  are  those  measures  of 
effectiveness  which  apply  to  the  fire  support  force  as  a whole  such  as: 
live  target  time,  which  Is  the  time  Interval  from  the  occurrence  of  a 
target  until  some  weapon  system  has  fired  the  expected  number  of  rounds 
required  to  achieve  the  required  effects  upon  the  target;  target  firing 
time,  which  Is  measured  to  the  Impact  of  the  first  flre-for-effect  volley 
or  salvo;  the  number  of  lost  targets,  that  Is,  targets  which  have  occurred 
within  the  fire  support  system  but  which  disappear  before  flre-for-effect 
commences,  either  because  they  displace  and  are  lost  to  the  observer  or 
because  they  close  with  (or  are  closed  by)  landing  force  units  and  can 
no  longer  be  attacked  by  the  fire  support  system. 

Generally,  there  are  four  levels  of  effectiveness  evaluation. 

These  are 

(1)  Force  (platform  mix) 

(2)  Platform 

(3)  System 

(4)  Subsystem  (nr  equipment) 

COMOPTEVFOR  Project  Officers  and  Analysts  are  normally  only  concerned  with 
the  selection  of  MOE's  at  the  last  tnree  levels,  that  Is,  excluding  force 
level  evaluations.  At  the  platform  level  the  Project  Officer's  interest 
may  be  in  how  well  a platform  would  perform  In  conducting  a particular 
type  of  mission  or  conducting  given  tactics  In  the  course  of  following 
a scenario.  At  this  level  the  measure  of  effectiveness  is  sometimes 
referred  to  as  a measure  of  operational  effectiveness  (MOOE),  that  is,  a 
MOOE  could  be  regarded  as  a measure  of  how  well  the  Naval  "unit"  (such 
as  ship,  aircraft,  submarine,  etc.)  performs  Its  mission  or  operational 
roles.  A related  measure,  called  a measure  of  operational  success  (MOOS), 
is  a measure  which  considers  not  only  the  "effectiveness"  as  determined 
by  the  MOOE  but  also  the  reliability  and  operational  availability  of  the 
equipment,  subsystems  and  systems  Involved.  The  MOOE  for  a platform  Is 


a function  of  the  Individual  system  MOE's  where  the  platform  Is  regarded 
as  being  comprised  of  a collection  of  systems.  The  systems  then  are 
comprised  of  subsystems  and  so  system  MOE's  can  be  expected  to  be  functions 
of  subsystem  MOE's.  This  relationship  between  MOE's  at  various  levels  of 
evaluation  Is  what  Is  referred  to  as  the  MOE  chain  or  the  hierarchy  of 
MOE's. 

In  the  selection  of  an  MOE  the  element  being  supported  Is  critical. 
Since  the  object  under  evaluation  either  supports  the  next  higher  level  In 
hierarchy  or  the  next  step  In  the  evaluation  process,  the  MOE  selected  should 
likewise  be  related  to  the  next  level  or  next  step.  The  detection  performance 
of  a sonar  or  the  kill  capability  of  a torpedo  should  be  evaluated  In  the 
context  of  the  overall  platform  performance.  This  Is  why  It  Is  Important  to 
go  to  at  least  one  higher  level  of  evaluation  In  .performing  effectiveness 
evaluations.  The  MOOE  Is  the  effectiveness  measure  at  the  platform  level 
whereas  detection  probability  and  kill  probability  are  Input  MOE's  from  the 
system  level.  In  Appendix  A are  presented  Illustrative  examples  of  typical 
MOOE's  that  are  candidates  for  consideration  In  OPTEVFOR  tests  and  evaluation. 

As  the  MOE  hierarchy  evolves  from  the  top  level  (l.e.,  plat  form ) 
to  the  lower  levels,  the  nature  or  form  of  the  MOE  changes.  At  the  lower 
levels  the  MOE's  become  less  "effectiveness  oriented"  and  more  "perfor- 
mance oriented".  For  example,  performance  oriented  MOE's  are  given  by 
such  quantities  as  detection  range,  tracking  accuracy,  and  circular  error 
probable  (CEP),  whereas  the  corresponding  effectiveness  oriented  (or 
performance  dependent)  MOE's  would  be  the  probability  of  detection  (a 
function  of  detection  range),  the  probability  of  successful  tracking 
(a  function  of  tracking  accuracy)  and  the  probability  of  target  kill  (a 
function  of  weapon  CEP). 

Furthermore,  MOE's  used  In  platform  and  system  level  evaluations 
are  generally  functions  of  what  are  called  "function  MOE's",  that  is, 

MOE's  which  relate  to  how  well  certain  necessary  functions  are  performed 
as  part  of  the  platform  or  system  level  evaluation.  For  example,  in  the 
attack  of  an  airborne  target  by  an  air-to-air  missile,  In  order  to  obtain 
target  kill  the  functions  of  launch,  guidance,  fuzing  and  kill  must  be 
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successfully  accomplished.  Figure  3.1  provides  an  Illustration  of  this 
example  showing  how  the  MOE  given  by  single  shot  kill  probability  depends 
on  the  corresponding  function  MOE's. 

It  Is  Important  to  note  that  at  the  function  level  the  MOE 
depends  on  "other  things  being  equal".  For  example,  If  other  things 
are  equal,  an  air-to-air  missile  with  a guidance  reliability  of  0.95 
Is  clearly  better  than  one  with  a guidance  reliability  of  0.80;  however, 
this  functional  MOE  comparison  does  not  tell  us  what  this  Improvement 
In  guidance  reliability  really  means  operationally.  The  missile  with 
the  higher  guidance  reliability  may  weigh  more  and  thus  the  aircraft 
must  carry  fewer  missiles  on  a sortie  or  It  may  be  harder  to  maintain 
In  an  operational  condition.  Generally,  a comparison  between  function 
MOE's  Is  not  as  meaningful  as  a comparison  at  the  next  higher  level  of  MOE's 
which  depend  upon  these  function  MOE's. 

A further  Illustration  of  function  MOE's  and  their  relationship 
to  the  next  higher  l£vel  MOE  Is  provided  In  Figures  3.2  and  3.3.  Referring 
to  Figure  3.2,  a platform  level  MOE  Is  given  by  SSK  versus  Transltor  effec- 
tiveness for  a submarine  on  a barrier  mission  with  the  specific  objective  of 
detecting  and  killing  any  enemy  submarine  encountered  in  the  patrol  area. 

In  this  case  the  functions  necessary  for  the  conduct  of  the  mission  are 
detection,  classification,  attack  and  kill.  The  effectiveness  evaluation 
can  be  conducted  at  the  platform  level  by  measuring  the  number  of  transltors 
killed  by  the  SSK  and  tne  number  of  valid  detection  opportunities  for  the 
SSK,  and  then  computing  the  ratio  of  these  two  quantities.  On  the  other 
hand,  depending  on  the  circumstances  of  the  test  and  the  available  data 
samples,  the  individual  function  MOE's  could  be  estimated  as  shown  and  then 
multiplied  to  obtain  an  estimate  of  the  next  higher  level  MOE.  Figure  3.3 
provides  a more  detailed  example  of  this  point  Involving  two  sub-levels 
(function  and  sub-function)  In  the  MOE  development  and  formulation  for  the 
case  of  an  ASW  helicopter  which  Is  attempting  to  localize  and  attack  a 
submarine  target. 

As  can  be  seen  from  these  two  examples,  tne  determination  of  data 
requirements  for  MOE  computation  depends  upon  the  level  of  evaluation  being 
performed.  This  Is  because  the  lower  level  MOE's  are  more  readily  evaluated, 
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whereas  the  platform  or  system  level  MOE's,  since  they  are  functions  of 
lower  level  MOE's,  have  more  complex  data  requirements.  The  general 
approach  to  structuring  data  requirements  Is  to  start  with  the  MOE  (or 
MOE's)  selected  for  evaluation  purposes  and  to  Identify  Its  formulation 
In  terms  of  lower  level  MOE's.  The  next  seep  Is  to  identify  the  formula- 
tion of  each  lower  level  MOE  Into  further  lower  level  MOE's  until  one 
reaches  the  level  at  which  data  can  be  readily  collected.  Figure  3.4 
provides  an  Illustration  of  this  process  In  terms  of  taking  the  function 
MOE's  and  Identifying  those  performance  parameters  necessary  to  compute 
them.  Furthermore,  Figures  3.1 -3.3  and  3.5  provide  good  Illustrations 
of  the  complete  decomposition  of  an  MOE  Into  lower  level  MOE's  and  their 
corresponding  data  requirements  In  addition  to  specifying  where  one  might 
obtain  the  necessary  data. 

In  many  cases  when  an  MOE  Is  expressed  as  a function  of  lower 
level  MOE's,  It  Is  possible  to  collect  data  directly  at  each  level  in  the 
hierarchy  so  as  to  compute  either  the  top  level  MOE  or  any  of  its  dependent 
lower  level  MOE's.  Such  is  the  case  Illustrated  In  Figure  3.6  for  detection- 
type  MOE's.  Generally  accepted  detection  oriented  MOE's  are  given  by  the 
average  detection  range  and  the  probability  of  detection  as  a function  of 
range.  The  latter  can  also  be  expressed  as  a function  of  target  aspect 
and  speed.  There  exists  an  intimate  relationship  between  these  MOE's  as 
Illustrated  In  Figure  3.6.  The  point  to  be  made  here  Is  that  at  a particu- 
lar evaluation  level  where  more  than  one  choice  of  an  MOE  exists,  some  of 
these  MOE's  can  be  computed  from  one  or  more  of  the  others.  In  a sense, 
this  implies  that  not  only  does  there  exist  a hierarchy  of  MOE's  between 
levels  of  evaluation,  but  also  there  exists  a hierarchy  between  MOE's  at 
a specified  level  of  evaluation.  The  decision  as  to  what  level  the  data 
should  be  collected  depends  upon  such  factors  as  available  sample  sizes, 
statistical  confidence  desired  In  the  results  obtained,  and  the  complexity 
of  the  analysis  Involved.  These  factors  would  normally  be  an  Integral  part 
of  the  project  plan. 

In  summary,  key  observations  to  be  made  relative  to  the  MOE 
hierarchy  and  the  selection  of  MOE's  are  as  follows: 
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(1)  MOE's  for  platforms,  systems  and  subsystems  depend  on 

the  Intended  use  of  these  platforms,  systems  and  subsystems. 

(2)  Many  times  more  than  one  MOE  may  be  appropriate. 

(3)  MOE's  can  be  combined  to  form  higher  level  MOE's  or, 
conversely,  MOE's  can  be  expressed  as  functions  of  lower 
level  MOE's. 

(4)  Lower  level  MOE's  are  more  readily  measured  because  of 
data  availability,  consequently,  to  evaluate  a higher 
level  MOE  one  must  know  Its  relationship  to  the  measurable 
lower  level  MOE's. 

4.0  USE  OF  THE  HANDBOOK  DATA  BASE 

In  order  to  establish  a data  base  for  use  by  Project  Officers  and 
Analysts  in  the  selection  of  measures  of  effectiveness  and  the  determination 
of  the  corresponding  data  requirements  and  MOE  formulation,  two  types  of 
MOE  reviews  were  performed. 

First,  a review  of  platform  level  types  of  MOE's,  representative 
of  MOOE's,  was  performed  using  the  results  of  a previously  conducted  study* 
for  the  Office  of  Naval  Research.  These  measures  of  effectiveness,  the 
applicable  missions  or  operational  situations,  the  corresponding  success 
criteria,  and  the  types  of  systems  or  subsystems  which  could  be  evaluated 
using  these  MOOE's  are  presented  In  Appendix  A. 

The  second  review  consisted  of  an  examination  of  previously  com- 
pleted OT&E  reports.  This  review  covered  Concurrent  Evaluations  of  ship- 
board and  airborne  systems;  Operational  Appraisals  for  shipboard  and 
combined  systems  or  equipments;  Operational  Assists  for  shipboard,  airborne 
and  combined  systems  or  equipments.  The  objective  of  this  review  was  to 
document  for  reference  purposes  the  types  of  systems  and  equipments  whose 
test  and  evaluation  Involves  the  services  of  OPTEVFOR  personnel.  Not  only 
were  specific  systems  and  equipments  Identified,  but  so  were  the  specific 
test  objectives,  the  measure(s)  of  effectiveness,  the  data  requirements, 


* "A  Study  of  Measures  of  Effectiveness  Used  In  Naval  Analysis  Studies", 
Vols.  1-4,  Ultrasystems,  Inc.,  31  Oct.  1972 
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data  sources,  and  MOE  formulation  Identified.  An  attempt  was  made,  even 
though  not  Including  all  such  projects,  to  provide  a representative  sample 
of  this  type  of  Information  for  OPTEVFOR  projects.  The  results  of  this 
survey  are  presented  In  Table  B-2  of  Appendix  B. 

In  order  to  facilitate  the  use  of  this  OT&E  data  base,  MOE  usage 
was  categorized  according  to  the  platform,  system,  subsystem  or  equipment 
area.  Twelve  basic  category  areas  were  selected  representing:  Aircraft  (A), 
Acoustic  Detection  & Countermeasures  (ADC),  Conmunlcatlons  (C),  Data  & 

Display  (DD),  Electromagnetic  Detection  & Countermeasures  (EDC),  Fire 
Control  (FC),  Infrared  & Optical  Detection  (IOD),  Missiles  (M),  Navigation  & 
Guidance  (NG),  Ordnance  (0),  Submarines  (S),  and  Surface  Ships  (SS).  Within 
each  area  the  MOE  Information  from  a project  report  was  then  separated 
according  to  the  specific  performance  or  evaluation  objective  for  the  plat- 
form, system,  subsystem  or  equipment  considered.  As  a result,  this  provided 
a "sorting  out"  of  MOE's  by  type  of  Item  evaluated  based  on  previous  MOE 
usage  In  OPTEVFOR  projects. 

The  basic  steps  to  be  followed  In  the  use  of  this  OT&E  data  base 
by  a Project  Officer  or  Analyst  can  be  described  as  follows: 

Step  1 Select  the  platform,  system,  subsystem  or  equipment  of 
Interest. 

Step  2 From  the  project  objectives  define  the  specific 
objectlve(s)  of  the  evaluation. 

Step  3 Use  the  Index  of  Table  B-3  to  determine  whether  or  not 
there  Is  Information  In  the  data  base  regarding  the 
evaluation  of  the  platform,  system,  subsystem  or  equip- 
ment of  Interest. 

Step  4 Under  the  assumption  that  Information  of  the  type 

desired  Is  In  the  data  base,  turn  to  the  appropriate 
data  1tem(s). 

To  Illustrate  these  steps,  suppose  the  Project  Officer  or  Analyst 
is  Interested  In  evaluating  an  alr-to-surface  antiradiation  missile  to  be 
launched  from  an  aircraft.  He  Is  not  interested  In  evaluating  the  performance 
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of  the  aircraft  ( 1 . e . , the  platform)  per  se  nor  Is  he  Interested  solely 
In  evaluating  the  performance  of  a particular  subsystem  of  the  missile. 

His  Interest  Is  with  the  missile  Itself.  Thus,  he  desires  to  know  what 
measures  of  effectiveness  could  be  used  for  a system  level  evaluation 
of  an  alr-to-surface  missile  - In  particular,  one  whose  Intended  target 
Is  a surface  radar.  Therefore,  referring  to  Table  B-3,  he  observes  that 
under  the  listing  for  missiles,  anti -radiation  there  Is  information  In 
area  code  M2.  Turning  to  page  B-107  In  Table  B-2,  for  the  specific 
objective  of  "killing"  the  radar,  the  MOE  given  Is  the  single  shot  kill 
probability  which  Is  defined  as  the  product  of  the  launch,  guidance  and 
fuze  reliabilities  and  the  kill  probability  against  the  target  given  a 
reliable  missile.  The  formulation  Is  given  for  each  of  these  reliability 
terms  and  the  sources  of  data  are  specified. 

If  the  Project  Officer  or  Analyst  Is  Interested  In  a platform 
level  type  of  evaluation,  specifically,  how  well  a submarine  performs  In 
the  Fixed  Barrier  Role,  that  Is  patrolling  a particular  area  with  the 
objective  of  detecting  and  killing  any  enemy  submarine  encountered,  then 
referring  to  Table  B-3  he  observes  that  there  are  three  items  In  the  data 
base  concerned  with  platform  level  evaluations  of  submarines,  namely.  In 
area  code  SI,  Items  SI-1,  SI -2  and  Sl-3.  Turning  to  page  B-139  In  Table  B-2, 
he  observes  that  the  Information  he  seeks  Is  given  by  data  Item  Sl-1.  There 
the  suggested  MOE  for  this  mission  is  given  by  SSK  versus  Transltor  effective 
ness,  which  would  also  correspond  to  a measure  of  operational  effectiveness. 
The  formulation  of  this  MOE,  the  data  requirements  for  Its  computation  and 
an  explanation  of  the  data  sources  are  provided.  Should  he  desire  to  read 
the  report  from  which  this  Information  was  obtained,  the  reference  is  given 
and,  for  ease  of  comparison  and  reading,  the  original  notation  as  used  in 
the  report  has  been  preserved. 

If  the  Project  Officer  or  Analyst  was  In  reality  only  interested 
in  evaluating  the  performance  of  the  submarine  sonar  In  this  barrier  mission, 
then  merely  selecting  a system  level  type  of  MOE  for  the  sonar  would  not 
suffice  nor  would  he  obtain  as  a result  a realistic  assessment  of  how  this 
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sonar  supports  the  performance  of  the  platform.  For  example,  data  Item 
A0C1-1  (see  page  B-12)  contains  MOE's  which  could  be  used  for  submarine 
sonar  evaluation,  such  as  average  detection  range,  flgure-of-merlt,  90% 
probability  of  detection  range  and  the  cumulative  probability  of  detection 
as  a function  of  range.  These  MOE's  In  themselves  say  nothing  about  the 
submarine  performance  In  this  mission.  How  good  the  sonar  Is  should  be 
evaluated  In  light  of  what  contribution  It  makes  to  overall  submarine 
performance,  that  Is,  we  need  to  examine  the  next  higher  level  of  effective- 
ness, given  In  this  case  by  the  MOOE  called  SSK  versus  Transltor  effectiveness. 
The  first  term,  Pq,  In  the  formulation  of  this  measure,  given  by  the  proba- 
bility that  the  SSK  detects  a transiting  submarine  without  first  being  killed, 
given  a detection  opportunity,  and  the  second  term,  Pg,  In  the  formulation 
of  this  measure,  given  by  the  probability  that  the  SSK  correctly  classifies 
a transiting  submarine  without  being  killed  between  the  time  of  detection  and 
time  of  classification,  given  that  the  transltor  has  been  detected,  also 
could  be  regarded  as  submarine  sonar  MOE's.  In  particular,  these  are 
function  MOE's  representing  how  well  the  functions  of  detection  and  classi- 
fication are  performed,  respectively.  By  computing  this  MOOE,  one  can 
evaluate  the  contribution  of  the  submarine  sonar  In  performing  both  of  these 
functions  to  the  overall  performance  of  the  submarine  In  the  barrier  role. 

A possible  result  of  Step  3 may  be  that  for  the  evaluation  level 
and  platform,  system,  subsystem  or  equipment  combination  of  interest  there 
Is  no  Information  of  the  type  desired  In  the  data  base.  The  data  base  Is 
not  Intended  to  be  all-inclusive,  thus  exceptions  will  occur.  However,  It 
may  be  possible  that  upon  reviewing  available  Information  for  similar 
systems  and  equipments  at  perhaps  a different  level  of  evaluation  the  Project 
Officer  (or  Analyst)  may  be  able  to  obtain  guidance  as  to  the  MOE's  which 
he  could  consider.  For  example,  most  MOE's  for  sonobuoys  could  be  used 
as  MOE's  for  sonars,  or  MOE's  for  missiles  are  In  many  cases  Independent 
of  whether  or  not  they  are  air-to-air,  alr-to-surface,  surface-to-surface 
or  surface-to-air  missiles.  In  any  case,  the  data  base  Is  designed  to  be 
a starting  point  In  the  selection  of  MOE's  to  be  used  In  OT&E  projects  not 
as  an  ending  point. 
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APPENDIX  A 

MEASURES  OF  OPERATIONAL 
EFFECTIVENESS  FOR  SELECTED 
NAVAL  PLATFORMS 
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TABLE  B-1  0T4E  Project  Areas 


COPE 

A 

ADC 

C 

OD 

EDC 

FC 

IOD 

M 

NG 

0 

S 

SS 


AREA 

Aircraft 

Acoustic  Detection  & Countermeasures 

Communications 

Data  & Display 

Electromagnetic  Detection  & Countermeasures 
Fire  Control 

Infrared  & Optical  Detection 
Missiles 

Navigation  & Guidance 
Ordnance 
Submarines 
Surface  Ships 
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TABLE  B-2  Operational  Test  & Evaluation 
HOE  Data  Base 


7 Area:  Aircraft  (A) 

i 


— 

CODE 

ITEM 

* 

A1 

Attack  Aircraft  (F8U-2) 

it 

A2 

ASW  Aircraft  (S-26) 

•Mir 

A3 

Fleet  Defense  Aircraft 

A4 

ASW  Helicopter 

A4-1 

SH-3A 

A4-2 

SH-3H 

A4-3 

DASH 

n 

4 


i 

1 


J 


AIRCRAFT  (A) 


A1  - Attack  Aircraft 

DESCRIPTION:  This  Is  a carrier  based  airplane  designed  for  a primary  mission 
of  a day  or  night  visual  fighter. 

(1)  SPECIFIC  OBJECTIVE:  Evaluate  the  capability  of  the  airplane  to  Intercept 
approaching  targets  while  under  ground  controlled  Intercept. 

MOE  ■ Average  kill  distance,  which  Is  defined  as  the  distance 
from  CAP  station  to  sue  jessful  Intercept  of  target 

REFERENCE:  Final  Report  on  Project  0P/V264/VV 
"Evaluation  of  the  F8U-2  Aircraft" 

21  March  1960,  UNCL. 


A2  - ASW  Aircraft 


DESCRIPTION:  This  Is  a modified  S-2E  airplane  with  enhanced  ASW  capability. 

It  contains  passive  directional  sonobuoys,  processing  and  display  equipment, 

an  acoustic  data  processor,  tape  recorder  and  sonobuoy  receiver. 

(1)  SPECIFIC  OBJECTIVE:  Evaluate  submarine  detection  capability  using 
sonobuoys . 

(MOE)^  ■ Mean  time  from  Initial  sonobuoy  drop  to  target  Initial 
line -of -bearing 

(MOE)2  * Mean  range  from  sonobuoy  to  submarine  at  determination 
of  Initial  OIFAR  llne-of -bearing 

(M0E)3  ■ Probability  of  obtaining  an  Initial  DIFAR  llne-of- bearing 

/Number  of  times  Initial  DIFARn 
m \ llne-of -bearing  was  obtained  / 

Number  of  detection  attempts 

(2)  SPECIFIC  OBJECTIVE:  Evaluate  submarine  localization  capability  using 
sonobuoys . 

(MOE ) i * Average  time  from  the  Initial  DIFAR  line -of -bearing 
to  the  designation  of  the  Initial  EP  (estimated 
position) 

(MOE)g  ■ Mean  EP  error 
(M0E)3  ■ Mean  DFX  (DIFAR  fix)  error 
(M0E)4  ■ Circular  error  probable  (CEP)  about  the  mean  EP 

(MOE) g ■ Circular  error  probable  (CEP)  about  the  mean  DFX 

(MOE)g  ■ Mean  number  of  EP's  generated  prior  to  generation  of  a DFX 
(MOE)7  ■ Mean  time  from  EP  to  designation  of  a DFX 

(MOE)g  ■ Mean  time  from  Initial  contact  to  designation  of  a DFX 

(M0E)g  ■ Average  number  of  sonobuoys  required  to  generate  a DFX 

(M0E)-|q*  Mean  time  from  the  designation  of  an  actual  DFX  to  active 
pattern  completion 

(MOE)^-  Average  number  of  DIFAR  sonobuoys  required  to  generate 
an  Initial  EP 


A2 


ASSUMPTION:  A OIFAR  fix  (DFX)  Is  defined  as  that  EP  so  designated  by 
the  flight  crew;  normally,  the  final  EP  prior  to  coitmenclng  active 
prosecution. 

REFERENCE:  Final  Report  on  Project  P/V3 

"Conduct  an  Operational  Appraisal  of  the  S-2G  Weapon  System" 
11  Sept.  1972,  SECRET 
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A3 


T 

4 


A3  - Fleet  Defense  Aircraft 


DESCRIPTION:  This  system  Is  designed  to  provide  a quick  reaction,  all- 
weather  fleet  defense  capability  against  enemy  surface-to-surface  missile 
launch  vessels.  The  aircraft  Is  equipped  with  an  alr-to-surface  missile 
system. 

(1)  SPECIFIC  OBJECTIVE : Evaluate  capability  using  airborne  radar  to 
detect  surface  vessels. 


(HOE) 


1 


(MOE), 


Probability  of  target  detection  as  a function  of  aircraft 
altitude 

Number  of  detections 

Number  of  detection  attempts 

Average  detection  range 


(2)  SPECIFIC  OBJECTIVE:  Evaluate  capability  using  airborne  radar  to  acquire 
surface  vessels. 

(MOE) 1 « Probability  of  target  acquisition  given  detection 

. Number  of  acquisitions 
Number  of  detections 

(M0E)2  ■ Average  acquisition  range 

(3)  SPECIFIC  OBJECTIVE:  Evaluate  capability  using  airborne  radar  to  track 
surface  vessels. 

MOE  ■ Probability  of  maintaining  radar  target  track  up  to 

missile  firing  as  a function  of  aircraft  altitude, 

target  speed,  sea  state,  attack  angle  and  target  aspect 

/Number  of  successful  radar\ 

. \ tracking  tests / 

Number  of  radar  tracking  tests 

(4)  SPECIFIC  OBJECTIVE:  Evaluate  missile  attack  capability  of  surface 
vessels. 

MOE  ■ Probability  of  successful  missile-target  Intercept  as 
a function  of  aircraft  altitude,  attack  angle,  launch 
range,  sea  state  and  target  aspect 


•** 
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REFERENCE: 


] 


Final  Report  on  Project  F/0255 

"Conduct  a Fleet  Operational  Investigation  of  Guided  Missile 
AIM-7E-2  (Sparrow)  as  an  Antiship  Missile" 

17  Oct.  1972,  SECRET 


1 

i 


i 


] 
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A4  - ASW  Helicopter 
A4-1 


DESCRIPTION:  This  Is  an  ASW  Helicopter  Attack  System  (HATS)  which  Is  a 
standard  SH-3A  helicopter  modified  to  Incorporate  multiple  ASW  sensors 
and  display  equipments.  This  system  Is  designed  to  permit  a single 
unassisted  helicopter  to  localize  and  attack  a high  speed  submarine. 

(1)  SPECIFIC  OBJECTIVE:  Evaluate  localization  and  attack  capability. 


MOE  * Probability  of  successful  localization  and  attack 

of  a submarine  for  given  localization  method 

/Number  of  times  localization  and  attack\ 

m \were  successful >_ 

/Number  of  localization  and  attackj 
'-attempts  / 


(2)  SPECIFIC  OBJECTIVE:  Evaluate  localization  capability. 


(MOE)^  * Probability  of  successful  conversion  of  a sonar 
contact  to  sonobuoys 


(moe)2 


(moe)3 


/Number  of  times  conversion  from  a sonar  contact 

'to  sonobuoys  was  successful - 

/Number  of  sonar  to  sonobuoy  conversion) 

\attempts  ' 

Probability  of  successful  conversion  of  a sonar 

contact  to  MAD 


/Number  of  times  conversion  from  a sonar\ 

^contact  to  MAD  was  successful /_ 

/Number  of  sonar  to  MAD  conversion^ 

'attempts  / 

Probability  of  successful  conversion  of  a single 

buoy  contact  to  a MAD  contact 


/Number  of  times  conversion  from  a single 
\ con tact  to  a MAD  contact  was  successful 
/Number  of  single  buoy  to  MAD  conversion^ 
‘attempts  / 


(MOE)^  = Probability  of  successful  conversion  of  a sonar 
contact  to  sonobuoys  to  a MAD  contact 


/Number  of  times  conversion  from  a sonar  contact 
. 'to  sonobuoys  to  a MAD  contact  was  successful 
/Number  of  sonar  to  sonobuoy  to  MAD  conversion^ 
'attempts  / 
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REFERENCE:  Final  Report  on  Project  F/0214 

"Fleet  Operational  Investigation  of  the  ASW  Helicopter  Attack 
System  (HATS)" 

3 March  1967,  CONF. 

A4-2 

DESCRIPTION:  This  helicopter  Is  designed  to  provide  a multlsensor,  multi- 
mission  capability.  It  has  primary  missions  of  ASW  (antisubmarine  warfare) 
and  ASMD  (anti -ship  missile  defense). 

(1)  SPECIFIC  OBJECTIVE:  Evaluate  self  navigation  capability. 

MOE  ■ Circular  error  probable  (CEP)  of  transit  to  datum  navigation 
error  as  a function  of  range  to  datum 

(2)  SPECIFIC  OBJECTIVE:  Evaluate  sonobuoy  drop  accuracy. 

MOE  ■ Circular  error  probable  (CEP)  of  sonobuoy  drop  error  as 
a function  of  pattern  spacing 

(3)  SPECIFIC  OBJECTIVE:  Evaluate  passive  acoustic  localization  capability 
using  sonobuoys. 

(MOE)j  * Median  time  to  establish  an  EP  (esti.  :ed  position) 

(M0E)2  3 Mean  time  to  establish  an  EP 

(M0E)3  ■ Median  EP  error 

(MOE)^  » Mean  EP  error 

(MOE)g  « Probability  of  establishing  an  EP 

/Number  of  trials  that  resulted  1n\ 

a v the  establishment  of  an  EP 

/Number  of  passive  acoust1c\ 

Viocallzatlon  trials  / 

(4)  SPECIFIC  OBJECTIVE:  Evaluate  Initial  attack  capability. 

MOE  3 Probability  of  valid  attack 

« Niwnber  of  valid  attacks 
»r  of  attacks 

(5)  SPECIFIC  OBJECTIVE:  Evaluate  active  datum  redetection  and  attack 
capability. 


A4 


(MOE)^  ■ Probability  of  redetection 

■ Number  of  valid  redetections 
/Number  of  active  datum  redetectlom 
land  attack  trials  / 

(H0E>2  ■ Probability  of  valid  attack  given  redetection 

/Number  of  valid  attacks\ 

* l after  redetection  / 

Number  of  valid  redetections 

REFERENCE:  Final  Report  on  Project  P/V4 

"Conduct  an  Operational  Appraisal  of  the  SH-3H  Weapons  System" 
2 Oct.  1973,  SECRET 

A4-3 

DESCRIPTION:  This  Is  a drone  ASM  helicopter  (DASH)  which  Is  designed  to 
position  an  unmanned  helicopter  over  a submarine  contact,  to  drop  homing 
torpedoes  on  the  contact,  and  to  return  the  drone  to  the  ship  under  all 
weather  conditions  compatible  with  the  operation  of  helicopters. 

(1)  SPECIFIC  OBJECTIVE:  Determine  weapon  delivery  capability. 

HOE  * Median  total  attack  error,  which  Is  defined  as  the 
distance  between  the  weapon  water  entry  position 
and  the  almpolnt  based  on  the  target's  actual  position, 
course  and  speed  at  time  of  weapon  water  entry. 

REFERENCE:  Final  Report  on  Project  C/S18  FY61 

"Evaluation  of  the  DASH  System  Using  the  USS  Hazelwood 
and  DSN-1" 

7 Aug.  1961,  CONF. 
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Area:  Acoustic 


CODE 

ADC1 
ADC1-1 
ADC 1-2 
ADC 1-3 
ADC 1-4 

ADC2 
A DC  3 
ADC4 

ADC  5 
ADC6 

ADC7 

ADC8 

ADC9 


TABLE  B-2  Operational  Test  & Evaluation 
MOE  Data  Base  (Continued) 


Detection  & Countermeasures  (ADC) 


ITEM 


Sonar 

Submarine  Sonar  (AN/BQR-16,  AN/BQR-19) 
Towed  Array  Sonar  (AN/BQR-15) 

Surface  Ship  Sonar  (AN/SQQ-23) 

Mine  Detection/Classification  Sonar 
(AN/SQQ-14,  AN/SQQ-16) 

Command  Active  Sonobuoy  System  (CASS) 

Sonobuoy  (AN/SSQ-20,  AN/SSQ-1) 

Submarine  Classification  and  Tracking 
Device  (SCAT) 

Electro-Acoustic  Decoy  (NIXIE) 

Acoustic  Noisemaker  (NAE  Beacon  Mk  3 
Mod  1) 

Acoustic  Minesweeping  Device 
(ROTOVAC  6X,  ROTOVAC  7X) 

Acoustic  Intercept  Receiver  (AN/WLR-9) 

Submarine  Acoustic  Warfare  System 
(SAWS) 


B-ll 


ADC1 


ACOUSTIC  DETECTION  & COUNTERMEASURES  (ADC) 


ADC1  - Sonar 

ADC 1 ~ 1 Submarine  sonar 

DESCRIPTION:  This  Is  a passive  sonar  system  designed  to  provide  sub- 

marines with  a capability  to  passively  detect  and  track  surface  targets. 

(1)  SPECIFIC  OBJECTIVE:  Determine  detection  capability. 

(M0E)-|  ■ Average  detection  range  against  surface  ships 

(MOE) 2 a Figure  of  merit 
* SI  - NL  + DI  - RD 

where 

SL  - target  radiated  noise  level 
NL  a background  noise  level 
01  * directivity  index 

RD  ■ recognition  differential,  which  is  defined  as  the 
signal -to-noise  ratio  at  which  the  probability  of 
detection  Is  50%. 

(MOE 3 90%  probability  of  detection  range  as  a function 
of  target  relative  bearing  sector  (forward  or 
hindsight),  target  type,  target  speed  and  iso- 
thermal layer  depth 

(M0E)4  = Cumulative  probability  of  detection  as  a function 
of  range 

REFERENCES:  (1)  Final  Report  on  Project  C/S56 

"Conduct  a Concurrent  Evaluation  of  the  AN/BQR-16 
HINDSIGHT  Sonar" 

16  Feb.  1970,  CONF. 

(2)  Final  Report  on  Project  C/S61 

"Conduct  a Concurrent  Evaluation  of  the  AN/BQR-19  Sonar 
System" 

13  May  1970,  SECRET 
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A0C1 


ADC1-2  Towed  Array  Sonar 

DESCRIPTION:  This  Is  a low  frequency*  passive,  towed  array  sonar  which 

Is  designed  to  detect  surface  vessels  and  submerged  submarines  Including 

high  performance  nuclear  submarines. 

(1)  SPECIFIC  OBJECTIVE:  Determine  detection  performance. 

(MOE)^  * Probability  of  detection  as  a function  of  range 
for  given  target  relative  bearing  sector  (bow, 
beam,  stern),  target  depth  In  relation  to  Isothermal 
layer  bcundary  (layer  separation,  no  layer  separa- 
tion), target  speed,  target  type,  and  own  ship  speed 

a Number  of  detections 
Number  of  opportunities 

(M0E)2  * 50%  detection  range,  which  Is  defined  as  the  range 
to  target  at  which  the  cumulative  probability  of 
detection  Is  50% 

(MOE)^  ■ Figure  of  merit,  given  target  relative  bearing 

sector,  line  spectrum,  target  speed,  and  target  type 
» SL  - NL  + 01  - RD 

where 

SL  « target  radiated  nolie  level 
NL  ■ background  noise  level 
DI  « directivity  Index 
RD  * recognition  differential 

(2)  SPECIFIC  OBJECTIVE:  Evaluate  classification  capability. 

(MOE)^  ■ Probability  of  a correct  classification  as  a 

function  of  target  speed,  target  type,  and 

target  relative  bearing  sector 

. Number  of  correct  classifications 
Number  of  classifications  made 

(M0E)2  * Average  time  to  classify  after  making  a detection 

REFERENCE:  Final  Report  on  Project  C/S59 

"Conduct  a Concurrent  Evaluation  of  the  AN/BQR-15  Sonar  System" 
26  June  1970,  SECRET 
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ADC 1-3  Surface  ship  sonar 

DESCRIPTION:  This  Is  a computer  coordinated,  high  powered,  simultaneous 
active/passive  sonar  system  which  utilizes  the  direct  propagation  path. 

The  major  features  of  the  sonar  are  a simultaneous  search  while  tracking 
capability,  digital  computer  control  and  signal  processing,  and  semi- 
automatic performance  monitoring  and  fault  localization. 

(1)  SPECIFIC  OBJECTIVE:  Determine  detection  performance  against  submarine 

targets . 

(M0E)1  - Range  for  SOX  cumulative  probability  of  detection 
for  given  target  characteristics (In-layer  or 
below- layer,  deep  water  or  shallow  water,  aspect 
angle) 

(M0E>2  ■ Probability  of  target  detection 

. Number  of  detections 
“ Number  of  opportunities 

(MOE )3  ■ Mean  detection  range 

(MOE)4  ■ Cumulative  probability  of  detection  versus  range 
for  given  target  characteristics  (In-layer  or 
below-layer,  deep  water  or  shallow  water,  aspect 
angle,  mean  wind  velocity,  mean  sea  state,  mean 
target  depth  (keel)  and  mean  layer  depth) 


(2)  SPECIFIC  OBJECTIVE:  Determine  classification  performance. 


(M0E)1  » Probability  of  correct  classification 

m Number  of  correct  classifications 
Number  of  classification  events 

(M0E)2  * Probability  of  classifying  a submarine  as  a 

submarine 


(moe)3 


/Number  of  times  submarine  target  was\ 

\c1ass1f1ed  as  submarine / 

/Number  of  classification  events  1n\ 

'which  sonar  target  was  submarine  / 

Probability  of  classifying  a non- submarine  as  a 

submarine 


( 


) 


Number  of  times  non- submat  inf,  target  was 

classified  as  submarine 

/Number  of  classification  events  In  which) 
vsonar  target  was  non-submarine  > 


B-14 


ADw  I 


(H0E)4 


(MOE)g 


(M0E)6 


Probability  of  classifying  a submarine  as  non 
submarine 

/Number  of  times  submarine  target  was\ 
'classified  as  non-submarine  / 

/Number  of  classification  events  In  whlchv 
Isonar  target  was  submarine  / 

Probability  of  an  Incorrect  classification 

occurring 

Number  of  Incorrect  classifications 
Number  of  classification  events 

Probability  of  an  undetermined  classification 

(Number  of  times  submarine  targets  and  non-\ 
submarine  targets  were  unclassified  J 

(undetermined)  /. 

Number  of  classification  events 


(M0E)? 


(moe)8 


(moe)9 


Probability  of  a sonar  target  submarine  - 

classified  as  submarine  event  occurring 

/Number  of  times  sonar  target  submarine  -\ 
^classified  as  submarine  event  occurred  / 
Number  of  classification  events  - ~ * 

Probability  of  a sonar  target  submarine  - 

classified  as  non-submarine  event  occurring 

/Number  of  times  sonar  target  submarine  - \ 
Vclasslfled  as  non-submarine  event  occurred/ 
Number  of  classification  events 

Probability  of  a sonar  target  non-submarine  - 

classified  as  submarine  event  occurring 

/Number  of  times  sonar  target  non-submarine  -' 
'classified  as  submarine  event  occurred  > 
Number  of  classification  events 


(MOE)^  ■ Probability  of  a sonar  target  non-submarine  - 

classified  as  non-submarine  event  occurring 

/Number  of  times  sonar  target  non-submarine  -\ 
m vclasslfled  as  non-submarine  event  occurred  / 
" Number  of  classification  events 

(MOE)^  ■ Probability  of  a sonar  target  submarine  - 

unclassified  event  occurring 

/Number  of  times  sonar  target  submarine  -> 

, 'unclassified  event  occurred / 

Number  of  classification  events 
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(HOE)<| 2 " Probability  of  sonar  target  non-submarine  - 

unclassified  event  occurring 

/Number  of  times  sonar  target  non-submarl  ne-i 

m 'unclassified  event  occurred 

" Number  of  classification  events 

(M0E)13  - Probability  of  a missed  opportunity 

(Number  of  times  sonar  target  submarine 
classified  as  non-submarine  events  or 
sonar  target  submarine  - unclassified 

_ events  occurred  

" /Number  of  classification  events  In  whlc 
'sonar  target  was  submarine 

(MOE)^  * Clue  availability,  which  Is  defined  as  the 

probability  of  a clue  being  present 

a Number  of  times  clue  used 
“ Number  of*  classifications  made 

(MOE)^g  * Clue  reliability,  which  is  defined  as  the  prob 

ability  of  a correct  classification  when  the 

clue  was  used 

/Number  of  correct  classifications  when  the\ 

„ 'clue  was  used  i 

Number  of  times  clue  was  used 

(MPE)-|g  ■ Clue  effectiveness,  which  Is  defined  as  the 

probability  that  the  clue  was  present  and  a 

correct  classification  occurred 

/Number  of  correct  classifications  when\ 

m ‘the  clue  was  used  

Number  of  classifications  made 

(MOE)^  » False  alarm  rate,  which  Is  defined  as  the  mean 

time  between  false  alarms 

, Total  time  of  detection  exercise 

/Number  of  sonar  target  non-submarine  -\ 
'classified  as  submarine  events  / 


ASSUMPTIONS: 

(1)  Classification  events  consist  of  six  possible  types, 
namely,  either  submarine  or  non-submarine  targets  and 
then  for  each  type  of  target  It  Is  either  unclassified, 
classified  as  submarine  cr  classified  as  non- submarine. 

(2)  The  operator  correlates  active  and  passive  detections 
of  the  same  target  In  making  a classification. 

(3)  The  event  counted  was  the  final  classification  that 
occurred  In  time,  regardless  If  It  was  entered  on  a 
passive  or  active  track.  This  was  done  In  order  to 
avoid  double  classification  on  the  same  target  and 
assumed  that  the  operator  utilized  all  available 
Information. 

(4)  Typical  clues  are  TCD  (target  center  display)  echo 
length,  echo  Intensity,  echo  quality,  echo  consistency 
and  echo  smoothness. 
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(3)  SPECIFIC  OBJECTIVE:  Determine  tracking  capability  by  mode  of  operation 
(alerted  or  non-alerted). 

(M0E)1  ■ Mean  percent  range  error  for  given  tracking 
Interval  (target  range  Interval) 

(M0E)2  * Mean  bearing  error  (deg)  for  given  tracking 
Interval  (target  range  Interval) 

(M0E)3  * Mean  In-range  error  (yds)  for  given  tracking 
Interval  (target  range  Interval) 

(M0E)4  « Mean  cross-range  error  (yds)  for  given  tracking 
Interval  (target  range  Interval) 

(M0E)5  ■ Mean  tracking  radial  error  (yds) 

(MOE)g  ■ Radial  probable  error  of  observed  target  position 
ASSUMPTIONS: 

(1)  For  the  purposes  of  analysis,  the  true  target  position 
was  assumed  to  be  a predicted  target  position  obtained 
from  a linear  least  square  process  using  a moving 
sequence  of  the  latest  ten  tracking  observations. 
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(2)  The  track  quality  vector  (Q-number)  Is  an  estimate 
of  the  difference  error  In  position  between  the  true 
target  position  and  the  sonar  measured  position. 

(3)  Radial  probable  error  Is  the  radius  of  the  circle 
around  the  superimposed  or  mean  prediction  range 
positions  In  a range  interval  or  moving  Interval  such 
that  SOX  of  the  Q-vectors  terminate  Inside  the  circle. 

REFERENCE:  First  Partial  Report  on  Project  P/SI  (Phase  1) 

"Conduct  an  Operational  Appraisal  of  the  AN/SQQ-23  Sonar  System" 
19  Aug.  1971,  CONF. 

ADC  1-4  Mine  Detectlon/Classlflcatlon  Sonar 

DESCRIPTION:  This  Is  a sonar  system  whose  purpose  Is  to  detect  and  classify 
mine- like  objects. 

(1)  SPECIFIC  OBJECTIVE:  Determine  mine  detection  capability. 

(HOE ) i ■ Probability  of  mine  detection 

• Number  of  mine  detections 
Number  of  detection  opportunities 

(MOE) g * Probability  of  mine  detection  versus  range 

/Number  of  mine  detections  within] 

„ Iglven  range  band / 

/Number  of  detection  opportunities) 

\w1th1n  given  range  band  ' 

(M0E)3  » Mean  Initial  detection  range 

(M0E)^»  Detection  probability  of  mines  as  a function  of 
search  path  width  vor  lateral  range  from  ship's 
track) 

/Number  of  mine  detections  within  specified  search  \ 

'path  width / 

"/Number  of  mines  within  specified  search  path  ) 

Vwldth  ’ 

(M0E)5«  Average  slant  range  at  which  bottom  objects  were 
detected 
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(HOE)g  * Average  number  of  objects  detected  per  run 

Number  of  objects  detected 
" Number  01*  valid  runs 

(MOE)^  ■ Percent  of  mines  and  minelike  objects  detected 

, Number  of  mines  and  mine! Ike  objects  detected  x 1QQ 
/Number  of  detection  opportunities  for  mines  \ uu 
' and  mlnel Ike  objects  ' 


(MOE)g  * Percent  of  mines  detected 


mi 


. Number  of  mines  detected 

Number  of  detection  opportunities  for  mines 

■ Percent  of  total  detections  which  were  mines 

a Number  of  mines  detected 

/Number  of  detection  opportunities  for  mines) 
(and  mlnel  Ike  ob.lects  ' 


X 100 


X 100 


land  mlnel Ike  objects 

ASSUMPTION:  Criterion  used  for  detection  was:  Illumination  of  a 
bottom  object  by  the  sonar,  recognition  of  this  Illumination  on  the 
search  Indicator  PPI  scope  by  the  operator,  and  the  determination  and 
marking  of  the  range  and  bearing  of  the  Illuminated  object. 

(2)  SPECIFIC  OBJECTIVE:  Evaluate  mine  classification  capability. 


(MOE) 


1 


(MOE), 


■ Average  slant  range  at  which  contacts  were  classi- 
fied, l.e.,  the  slant  range  at  which  a contact, 
which  has  been  detected  and  transferred  to  the 
classify  Indicator  B-scope,  Is  Initially  classified 

* Probability  of  correct  classification  of  mines 

/Number  of  correct  classifications  of  mines  as  \ 

(mlnellke  ' 

/Number  of  classification  attempts  on  mines 
((Including  regained  contacts) 


) 


(MOE). 


Percent  correct  classifications  of  mlnellke  non- 
mine objects  as  non-mine 


/Number  of  correct  classifications  of  non-\ 

'mlnellke  objects  / 

/Number  of  classification  attempts  on  non-  \ 
(mlnellke  objects  (Including  regained  contacts)/ 


X 100 
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(MOE) . 


(MOE), 


(MOE). 


(HOE). 
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■ Percent  detections  classified 

. Number  of  classifications  made  at  least  once  x ,Q0 
Number  of  mines  and  mtnenke  objects  detected  A uu 


Percent  correct  classifications  at  least  once 

Number  of  classifications  correct  at  least  once 
Number  of  classifications  made  at  least  once 


X 100 


• Percent  detection  opportunities  detected,  classified 
and  classified  correctly  at  least  once 

, Number  of  classifications  correct  at  least  once  x 10Q 
/Number  of  detection  opportunities  for  mines  and  \ 

'mine like  objects  ' 

■ Mean  time  required  to  classify  a mine  as  minelike  after 
gaining  Initial  contact 


REFERENCES:  (1)  Final  Report  on  Project  C/S12  FY  61 

"Concurrent  Evaluation  of  the  AN/SQQ-14  Mine  Classifying/ 
Detecting  Set" 

3 Dec.  1962,  CONF. 

(2)  Final  Report  on  Project  0/S153 

"Conduct  an  Operational  Evaluation  of  the  Mine  Detection/ 
Classification  Sonar  Set  AN/SQQ-16" 

4 Aug.  1970,  CONF. 
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ADC2  - Command  Active  Sonobuoy  System  (CASS) 

DESCRIPTION:  This  system  consists  of  sonobuoys,  a command  signal  generator 
and  a signal  data  processor  which  operates  In  conjunction  with  the  sonobuoy 
receivers.  The  sonobuoys  are  radio  controlled  and  launched  from  an  airplane 
to  detect,  locate,  track  and  classify  underwater  targets.  This  system  Is 
designed  to  provide  the  airplane  with  a command-active  sonar  capability. 

(1)  SPECIFIC  OBJECTIVE:  Evaluate  the  detection  capability  of  the  system 
against  submarines. 

(MOE ) ^ * Cumulative  percentage  of  contacts  as  a function 
of  range  and  pulse  mode 
(M0E)2  ■ Mean  maximum  contact  range 

ASSUMPTIONS: 

(1)  Contact  percentage  Is  the  ratio  of  the  number  of  trials 
in  which  target  contact  Is  gained  to  the  total  number 
of  trials  conducted  for  a given  set  of  test  variables. 

(2)  Contact  range  Is  the  range  at  which  contact  was  lost 

on  an  outbound  transit  and  gained  on  an  Inbound  transit. 

(2)  SPECIFIC  OBJECTIVE:  Evaluate  the  capability  of  the  aircraft  to  con- 
vert from  passive  DIFAR  fixing  to  a CASS  detection. 

MOE  ■ Probability  of  conversion  to  at  least  one  valid 

echo  as  a function  of  DIFAR  fix  error 

u Number  of  successful  conversions 
Number  of  conversion  attempts 

(3)  SPECIFIC  OBJECTIVE:  Evaluate  CASS/MAD  localization  capability. 

MOE  • Localization  success  percentage 

/Number  of  times  localization^ 

. vis  successful  / 100 

Number  of  localization  attempts 

(4)  SPECIFIC  OBJECTIVE:  Evaluate  the  capability  of  the  airplane  to  reattack 
submarine  contacts. 

MOE  ■ Percent  successful  reattacks,  Culled  the  reattack 
success  rate 

, Number  of  successful  reattacks  inft 
Number  of  reattack  attempts  x w 
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(5)  SPECIFIC  OBJECTIVE:  Evaluate  active  tracking  capability. 

(MOE)j  ■ Percent  contact  time  on  at  least  one  buoy  as  a 

function  of  range  and  sea  state 

/Total  contact  time  on  at  least! 

„ ‘one  buoy 1nn 

Total  opportunity  time 

(M0E)2  * Percent  contact  time  on  at  least  two  buoys  as  a 

function  of  range  and  sea  state 

/Total  contact  time  on  at  1east\ 

a Uwo  buoys  

Total  opportunity  time 


x 100 


ASSUMPTION:  The  time  during  which  the  submarine  Is  within  sono- 
buoy  range  Is  the  opportunity  time. 

(6)  SPECIFIC  OBJECTIVE:  Evaluate  classification  capability. 

(MOE)^  * Valid  contact  percentage  as  a function  of  pulse 
mode 

. Number  of  valid  contacts  reported  .. 

TotaT  contacts  reported x 100 

(MOEjg  " False  contact  percentage  as  a function  of 

pulse  mode 

, Number  of  false  contacts  reported  lnn 
Total  contacts  reported  • * w 

REFERENCE:  First  Partial  Report  of  Phase  II  on  Project  0/V84 

"Conduct  an  Operational  Evaluation  of  the  Command  Active 
Sonobuoy  System  (CASS)" 

30  August  1971 , CONF. 
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ADC3  - Sonobuoy 

DESCRIPTION:  This  sonobuoy  Is  designed  for  launching  from  ASW  aircraft 
for  the  purpose  of  detecting  and  tracking  submerged  cavltatlng  submarines. 

(1)  SPECIFIC  OBJECTIVE:  Determine  bearing  accuracy. 

(MOE)^  ■ Average  bearing  error 

(I40E) g “ Average  bearing  error  as  a function  of  target  azimuth 

(2)  SPECIFIC  OBJECTIVE:  Evaluate  detection  capability. 

(M0E)<|  ■ Average  maximum  detection  and  tracking  range  as  a 
function  of  aspect  (bow  or  stern) 

(M0E)2  11  Average  maximum  detection  range 
(M0E)3  - Percentage  detections  versus  range  for  given  target 
aspect 

(3)  SPECIFIC  OBJECTIVE:  Evaluate  sonobuoy  reception  capability. 

MOE  ■ Average  maximum  radio  frequency  (RF)  range  as  a function 
of  type  of  approach  (Inbound  or  outbound) 

ASSUMPTIONS: 

(1)  The  maximum  outbound  range  Is  that  range  at  which  either  the 
compass  signal  or  the  audio  signal  Is  lost. 

(2)  The  maximum  Inbound  range  Is  that  range  at  which  both  compass 
and  audio  signals  are  regained. 

(4)  SPECIFIC  OBJECTIVE:  Evaluate  sonobuoy  classification  capability. 

MOE  ■ Percentage  classifications  versus  range  for  given  target 
aspect 

(5)  SPECIFIC  OBJECTIVE:  Evaluate  sonobuoy  capability  to  fix  the  position 
of  a submarine. 

MOE  ■ Average  radial  fix  error  as  a function  of  range  and  angle 

(6)  SPECIFIC  OBJECTIVE:  Evaluate  capability  to  convert  sonobuoy  bearings 
to  MAO  detections. 


rsi 


A0C3 


MOE  ■ Percent  MAO  conversions 
Number  of  MAO  marks 


Number  of  runs 


x 100 


REFERENCES:  (1)  Final  Report  on  Project  0P/V218/J1 5-1 1 

"Tactical  Evaluation  of  the  AN/SSQ-20  Passive  Directional 
Sonobuoy  In  ASW  Operations" 

25  Nov.  1960,  CONF. 

(2)  Final  Report  on  Project  0/V42  FY64 

"Conduct  an  Operational  Evaluation  of  the  AN/SSQ-1 
Directional  Listening  Sonobuoy" 

5 Oct.  1964,  SECRET 

(3)  Supplementary  Report  on  Project  C/V2  FY61 

"Lofar  Detection  and  Classification  Capability  Against  USS 
Nautilus  (SSN-571 )" 

8 Feb.  1963,  SECRET 


A0C4 


ADC4  - Submarine  Classification  and  Tracking  (SCAT)  Device 

DESCRIPTION:  This  device  Is  a mechanical  noise  maker  which,  when  attached 
to  the  hull  of  a moving  submarine,  generates  noise  that  can  be  tracked  by 
a destroyer's  sonar. 

(1)  SPECIFIC  OBJECTIVE:  Determine  the  surface  ship's  ability  to  classify 
and  track  a submerged  submarine  using  the  SCAT  device. 

(MOE)j  * Average  detection  range  of  submarine  with 
SCAT  device  attached 

(MOE )2  ■ Average  maintenance  of  contact  range 

(2)  SPECIFIC  OBJECTIVE:  Determine  the  capability  of  a SCAT  device  to  hit 
and  attach  to  the  hull  of  a submerged  submarine. 

(M0E)1  ■ Probability  of  hit 

a Number  of  hits  recorded 
Number  of  rounds  fired 

(M0E)2  ■ Probability  of  hit  and  attachment 

/Number  of  devices  which  hit  and\ 

a \ attached  to  the  submarine l_ 

Number  of  rounds  fired 

(MOE)3  » Probability  of  hit,  attachment  and 

proper  operation 

/Number  of  devices  which  hit  and  attached  \ 
m Uo  a submarine  and  then  operated  properly/ 

Number  of  rounds  fired 

REFERENCES:  (1)  Final  Report  on  Project  C/S25  FY62 

"Concurrent  Evaluation  of  SCAT  Using  Hedgehog  Delivery" 

4 Sep.  1962,  CONF. 

(2)  Final  Report  on  Project  C/V10  FY64 

"Concurrent  Evaluation  of  Airborne  Dispensing  System  for 
Submarine  Classification  and  Tracking  Device  (SCAT),  Mk  1 
Hod  0" 

28  Sep.  1964,  CONF. 
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ADC5  - Electro-Acoustic  Decoy 

DESCRIPTION:  This  system  Is  designed  for  the  protection  of  destroyer- 
type  ships  from  acoustic  homing  torpedoes.  It  Is  a towed  acoustic 
projector  that  transmits  a selectable  variety  of  sound  signals  Into  the 
sea  to  decoy  torpedoes  away  from  the  Intended  target  ship. 


(1)  SPECIFIC  OBJECTIVE:  Determine  ability  of  system  to  decoy  passive 
torpedoes. 


(HOE), 


Percent  time  decoy  controlled  the  torpedo 


(Total  amount  of  time' 
torpedo  was  Influ- 
enced by  decoy  ) 


♦ 


/Total  amount  of  t1me\ 
( torpedo  spent  search- 
l Ing  after  acquiring  ) 
\ decoy 


/Total  run  time  after  the  torpedo  enabled 
'until  first  hit  or  motor  cut-off 


x 100 


(MOE)2  ■ Probability  of  preventing  a hit  on  the  target  ship 

a , Number  of  hits  on  target  ship 
Number  of  vaHd  torpedo  runs 


ASSUMPTIONS: 

(1)  If  no  countermeasure  Is  present,  the  torpedo  would  hit  the  target 
ship  on  Initial  attack. 

(2)  The  target  ship  1$  unaware  of  the  torpedo  being  launched  and 
therefore  remains  on  steady  course  and  speed. 

(3)  The  target  ship  was  considered  to  be  hit  when  either  the  torpedo 
entered  a given  length  line  conformal  to  the  edges  of  the  target 
ship  or  the  torpedo  was  looking  within  a given  azimuth  angle  of  the 
target  ship's  propellers  and  had  entered  a circle  of  given  radius 
about  the  propellers. 

(4)  Valid  torpedo  runs  are  based  on  subtracting  from  the  number  of 
torpedo  launches  the  number  of  runs  with  torpedo  malfunctions, 
Improper  geometry,  erratic  torpedo  behavior,  lost  torpedoes. 
Improper  torpedo  settings  and  decoy  off. 

REFERENCE:  Final  Report  on  Project  C/S63 

"Evaluate  the  NIXIE  Torpedo  Countermeasure  System" 

21  April  1971,  SECRET 
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ADC6  - Acoustic  Nolsemaker 

DESCRIPTION:  This  Is  an  expendable,  elec'  ’o-mechanlcal , broadband  acoustic 
nolsemaker  designed  as  a torpedo  countermeasure. 

(1)  SPECIFIC  OBJECTIVE:  Determine  capability  of  nolsemaker  to  decoy 
torpedoes . 

MOE  ■ Probability  of  decoying  a torpedo 

. Number  of  runs  on  which  torpedo  was  decoyed 
Number  of  valid  torpedo  runs 

ASSUMPTION:  To  be  considered  effective  the  beacon  must  prevent  the  torpedo 
from  completing  an  attack  on  the  target  at  anytime  during  the  operation  of 
the  beacon. 

REFERENCE:  Final  Report  on  Project  0/S97 

"Conduct  an  Operational  Evaluation  of  the  NAE  Beacon  Mk  3 Mod  1" 
28  July  1967,  SECRET 
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ADC7  - Acoustic  Mine sweeping  Device 

DESCRIPTION:  This  1$  a motor-driven,  cavitation-type  acoustic  minesweeping 
device  which  Is  designed  to  counter  acoustic  sea  mines  by  generation  of 
broadband  sound. 


(1)  SPECIFIC  OBJECTIVE:  Determine  mlnesweep  capabilities  of  device. 


(M0E)<j  * Maximum  lateral  actuation  range  for  given  mine 
type  and  depth 


(moe)2 


where 


Sweep  width  against  a given  mine  type  and  depth 


k /Number  of  actuations^ 

2 Y'  \1n  range  band  1 / /Length  of  \ 

/Number  o/  opportunities^  \ range  band  1/ 
V 1 n range  band  1 I 


p(x)  ■ lateral  range  probability  of  detection  function 
k ■ number  of  non-overlapplnr  range  bands 


REFERENCE:  Final  Report  on  CNO  Project  C/S44 

"Concurrent  Evaluation  of  the  Minesweeping  and  Clearance 
System  $26-01,  200-HP  Cavitation  Acoustic  Sweep  Device, 
ROTOVAC  6X  and  100-HP  Cavitation  Acoustic  Sweep  Device 
ROTOVAC  7X" 

6 Dec.  1968,  SECRET 
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ADC8  - Acoustic  Intercept  Receiver  (AIR) 

DESCRIPTION:  This  device  Is  designed  to  automatically  alert  submarine 
personnel  to  active  underwater  acoustic  signals  emitted  from  other 
platforms  and/or  weapons. 

(1)  SPECIFIC  OBJECTIVE:  Determine  detection  capability  against  active 
acoustic  torpedoes. 

MOE  ■ Cumulative  probability  of  detection  versus  range 

(2)  SPECIFIC  OBJECTIVE:  Determine  detection  capability  against  active 
search  sonars  and  active  sonobuoys. 

(MOE ) ^ ■ Average  detection  range  as  a function  of  active 
sonar  type,  AIR  platform  depth,  active  sonar 
transducer  depth  and  layer  depth 

(M0E)2  ■ Average  range  advantage  over  counterdetection 

, Average  detection  range 

Average  counterdetection  range 

(3)  SPECIFIC  OBJECTIVE:  Determine  ability  to  detect  underwater  communications. 

MOE  ■ Average  detection  range 

REFERENCE:  Final  Report  on  Project  C/S71 

"Conduct  a Concurrent  Evaluation  of  the  AN/WLR-9" 

18  Nov.  1971,  SECRET 
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ADC9  - Submarine  Acoustic  Warfare  System  (SAWS) 

DESCRIPTION:  This  system  Is  designed  to  provide  enhancement  of  the  ability 
to  detect  and  classify  acoustic  emissions  from  active  and  passive  targets. 
It  provides  for  an  automatic  sonar  alert  upon  receipt  of  radiated  line 
spectrum  from  a torpedo  or  platform. 


(1)  SPECIFIC  OBJECTIVE:  Evaluate  detection  capability  of  sonar  system  In 
conjunction  with  this  subsystem. 


MOE  ■ Average  detection  range  as  a function  of  submarine  type, 
submarine  speed  and  torpedo  approach  bearing 

(2)  SPECIFIC  OBJECTIVE:  Evaluate  sonar  system  classification  capability 
In  conjunction  with  this  subsystem. 


(MOE), 

(moe)2 


Percent  correct  classification  given  detection 

Number  of  correct  classifications  .. 

Number  "of  detections x 100 

Percent  runs  on  which  both  detection  and  classification 

occurred 


(moe)3 


/Number  of  runs  on  which  detection  and 

^classification  occurred 

Number  of  valid  runs 


x 100 


Percent  runs  on  which  both  detection  and  correct 


classification  occurred 


(moe)4 

(moe)5 


/Number  of  runs  on  which  detection  and 

^correct  classification  occurred 

Number  of1  valid  runs 


x 100 


Average  classification  time  when  correct 
Average  classification  time  when  Incorrect 


(3)  SPECIFIC  OBJECTIVE:  Evaluate  capability  of  submarine  to  react  to 
Impending  torpedo  attack. 


MOE  ■ Probability  of  detection,  correct  classification  and 
successful  evasion 

' P1  P2  P3 

where 

P^  ■ probability  of  timely  detection  and  classification 
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a Number  of  detection  and  classification  successes 
Number  of  valid  runs 

f (TltT2,T3tT4) 

" Number  of  valid  runs 

(NOTE:  For  determination  of  f see  assumption.) 

?2  " probability  of  correct  classification  given  detection 

. Number  of  correct  classifications 
Number  of  detections 

P,  * probability  of  successful  evasion 

-9<T,> 

(NOTE:  g Is  determined  using  a simulation  program  developed  by 
the  Naval  Coastal  Systems  Laboratory.) 

Tj  ■ minimum  time  available  to  successfully  evade,  which  represents 
the  time  prior  to  Impact  at  which  evasion  action  must  begin 
In  order  to  be  successful 

T2  ■ time  to  Impact,  which  represents  the  time  from  torpedo 
detection  to  torpedo  Impact  If  no  evasive  action  were  to 
be  taken  and  the  torpedo  ran  a direct  Intercept  course 
T3  ■ time  to  classify 
T^  ■ time  for  000  reaction 

ASSUMPTION:  If  T2  ' > ^3  + ^4’  **ien  8 run  Is  considered  to  be 

successful  In  terms  of  detection  and  classification;  otherwise, 
unsuccessful.  In  other  words,  the  MOE  Is  established  by  measuring 
detection  range,  converting  that  to  time  to  Impact  and,  after  sub- 
tracting reaction  time,  assessing  whether  or  not  sufficient  time 
remains  to  successfully  evade  the  torpedo. 

REFERENCE:  Final  Report  on  Project  C/S85 

"Concurrent  Evaluation  of  SAWS  (Submarine  Acoustic  Warfare 
System)" 

7 Dec.  1973,  SECRET 
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TABLE  B-2  Operational  Test  & Evaluation 
MOE  Data  Base  (Continued) 


Area:  Communications  (C) 


CODE 

ITEM 

Cl 

UHF  Transceiver  (AN/WSC-3) 

C2 

Sounder  Receiver  System  (SRS) 

C3 

Report  Receiver-Transmitter  (RRT) 

C4 

Radio  Transmitter  (AN/WRA-3) 

C5 

Data  Cormunl cations  Set  (HICAPCOM) 

C6 

Drone  Control  Set 

C7 

Message  Processing  and  Distribution 
System  (MPDS)  and  Facilities  Control 
System  (FCS) 
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COMMUNICATIONS  (C) 


Cl  - UHF  Transceiver 

DESCRIPTION:  This  Is  designed  to  provide  a satellite  communl cations  capabil- 
ity for  small  ships  and  submarines.  It  also  has  a llne-of-slght  (LOS)  mode 
which  provides  for  direct  path  communications  between  stations. 

(1)  SPECIFIC  OBJECTIVE:  Determine  the  adequacy  of  voice  communications  for 
both  plain  voice  and  secure  voice. 

(MOE)^  ■ Mean  error  rate,  which  Is  defined  as  the 
number  of  words  missed  per  25-word  message 

(MOE )g  * Probability  that  a rhyme  word  transmitted  by 
this  system  Is  correctly  Interpreted 

/Average  number  of  words  \ 

_ 'wrong  per  N-word  message/ 

1 ‘ N 

(MOE)j  - Percent  sentence  Intelligibility 

(NOTE:  (M0E)3  Is  determined  from  (M0E)2  using  a 

conversion  scheme  developed  In  "Speech  Intelligibility 
In  Naval  Aircraft  Radios",  NELC  Report,  2 Aug.  1972.) 

(2)  SPECIFIC  OBJECTIVE:  Determine  teletype  communications  performance. 

(MOE)^  ■ Mean  character  error  rate,  which  Is  defined 
as  the  average  number  of  character  errors 
per  1000  character  message  as  a function  of 
satellite  elevation  angle 

(M0E)2  ■ Gross  error  rate,  which  Is  defined  as  the 
percent  of  messages  that  had  more  than  10 
character  errors  per  1000  character  message 
as  a function  of  satellite  elevation  angle 

(3)  SPECIFIC  OBJECTIVE:  Determine  data  communications  performance. 

MOE  ■ Bit  error  rate,  which  Is  c rined  as  the  number 
of  bits  missed  per  second  for  a given  data 
rate  (In  bits  per  second)  and  transmission  mode 


REFERENCE:  Final  Report  on  Project  0/S181 

"Conduct  an  Operational  Evaluation  of  the  UHF  Satellite  Ship/ 
Submarine  SATCOM  Terminal  (AN/WSC-3)" 

7 Jan.  1974,  CONF. 


C2  - Sounder  Receiver  System  (SRS) 

DESCRIPTION:  This  Is  a specialized  high  frequency  radio  receiver  which 
receives  a signal  consisting  of  a specified  number  of  discrete  frequencies 
from  a sounder  transmitter.  These  frequencies  provide  an  Indication  of  the 
bands  of  frequencies  which  may  be  propagating  within  a specified  range  band 
when  received  and  displayed  by  the  Sounder  Receiver  System. 

(1)  SPECIFIC  OBJECTIVE:  Determine  consistency  of  SRS  optimum  antenna 
determination. 

HOE  « !!uinb?r  of  usable  CER's 

nut  Total  number  of  CER  determinations 

where 

CER  * character  error  rate,  which  Is  that  number 
of  erroneous  characters  received  on  a tele- 
type versus  a known  number  of  correct  char- 
acters transmitted. 

(2)  SPECIFIC  OBJECTIVE:  Determine  consistency  of  SRS  frequency  Indications. 

/Number  of  times  a desired  frequency  was\ 

^ascertained ) 

' t;l  /Humber  of  times  a decision  was  made) 

'to  select  a new  frequency  ' 

(Number  of  usable  non-SRS  operating  fre-  \ 
quencles  lying  outside  of  the  recommended) 
operating  ranges  of  both  the  non-SRS  clr-/ 

- cult  antenna  and  the  optimum  antenna  / 
vnucy2  * /Total  number  of  usable  operating  fre-\ 

V quencles  for  each  radio  path  / 

(NOTE:  (M0E)2  Is  called  the  ratio  of  failures  to 

total  attempts,  since  a usable  frequency  outside 
the  recommended  operating  range  was  considered  a 
failure  of  the  SRS  to  Indicate  a usable  frequency.) 

REFERENCE:  Final  Report  on  Project  0/S107 

"Conduct  an  Operational  Evaluation  of  the  Oblique  Incidence 
Ionospheric  Sounder  System" 

23  Sept.  1969,  UNCL. 
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C3  - Report  Receiver-Transmitter  (RRT) 

DESCRIPTION:  This  equipment  Is  designed  to  apply  and  detect  Information  In 
the  form  of  low  frequency  signals  modulating  the  carrier  of  any  voice  communi- 
cation equipment.  It  Is  used  In  conjunction  with  shipboard  and  aircraft 
conmunlcatlons  equipment. 

(1)  SPECIFIC  OBJECTIVE:  Determine  communication  capability. 


(HOE)^  » Percent  of  RRT  messages  received 

_ Number  of  RRT  messaoes  received  .. 

(lumber  of  MT  trensSlsslons * 100 

(M0E)2  * Percent  RRT  messages  received  that  were  displayed 

accurately 


/Number  of  accurately  displayed 

\RRT  messages 

/Number  of  RRT  messages) 

\ received  / 


x 100 


REFERENCE:  Final  Report  on  Project  F/0  148  FY63 

"Fleet  Operational  Investigation  of  ASW  Report  Receiver 
Transmitter" 

16  April  1964,  CONF. 


C4  - Radio  Transmitter 


DESCRIPTION:  This  radio  communications  transmitting  equipment  Is  designed 
for  use  as  a modulator  for  standard  shipboard  and  submarine  transmitters. 


(1)  SPECIFIC  OBJECTIVE:  Evaluate  transmission  accuracy. 


(HOE), 


(moe)2 


Percent  of  transmissions  detected  which  are  satis* 


factorlly  transcribed  Into  legible  copy 


(Number  of  detected  transmissions' 
satisfactorily  transcribed  Into 

legible  copy > 

Number  of  detected  transmissions 


x 100 


Percent  transmissions  with  textual  errors 


/Number  of  transmissions 
\w1th  textual  errors 
Number  of  transmissions 


(MOE )3  ■ Average  number  of  errors  per  message 
(MOE)^  ■ Average  number  of  errors  per  character  sent 

REFERENCE:  Final  Report  on  Project  0/S66  FY63 

"Conduct  an  Evaluation  of  the  AN/WRA-3  Radio  Transmitter" 


11  April  1963,  SECRET 


C5  - Data  Communications  Set 


DESCRIPTION:  This  set  Is  designed  to  provide  secure  and  rapid  tactical 
communications  between  ships  In  dispersed  formations. 

(1)  SPECIFIC  OBJECTIVE:  Determine  traffic  handling  capability. 

MOE  ■ Data  rate  achieved  (In  words  per  minute) 

REFERENCE:  Final  Report  on  Project  C/S19  FY  61 

"Concurrent  Evaluation  of  a High  Capacity  Communications 
(HICAPCOM)  System" 

21  August  1962,  CONF. 
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C6  - Drone  Control  Set 

DESCRIPTION:  This  system  Is  designed  to  send  conmands,  receive  telemetry 
and  track  a drone,  both  In  range  and  azimuth,  via  an  RF  (radio  frequency) 
link  from  either  a shore  or  shipboard  Installation. 

(1)  SPECIFIC  OBJECTIVE:  Determine  message  decoding  performance. 

NOE  a Command  message  error  probability,  which  Is  defined 
as  the  probability  that  the  system  transponder  will 
error  in  decoding  a word  In  the  command  message  link 
for  given  maximum  word  length  (bits)  and  received 
target  strength  (dbm) 

. Number  of  words  with  decoding  errors 
Number  oil1  word  decoding  attempts 

REFERENCE:  Phase  II  Report  on  Project  X/C8 

"Conduct  an  Operational  Assist  of  the  Integrated  Target  Control 
System" 

5 March  1974,  UNCL. 
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C7  - Message  Processing  and  Distribution  System  (MOPS)  and  Facilities 
Control  System  (FCS) 

DESCRIPTION:  The  MPDS  Is  a stored  program,  three  computer  system  designed 
to  process,  store,  log  and  Internally  distribute  record  message  traffic 
and  digital  data  "on-line"  with  radio  receiving  and  transmitting  equipment. 
The  FCS  provides  for  quality  monitoring  of  communications  circuits,  for 
generation  of  central  frequency  and  time  signals,  and  for  patching  and 
adjusting  of  radio  frequency  and  terminal  equipments. 

(1)  SPECIFIC  OBJECTIVE:  Evaluate  the  capability  of  the  MPDS  to  do  message 
processing. 

HOE-  jjp, 


where 


n 

C, 


message  recognition  factor 

message  distribution  factor 

message  journaling  factor 

message  transmittal  relay  factor 

broadcast  screening  accuracy 

1 _ Number  of  broadcast  screening  errors 
Number  of  broadcast  messages 

operational  availability 

1 . Total  downtime 
" Total  time  in  use 

measure  of  effectiveness  for  the  FCS 

i n 

antilog  - ^ log  Ci 
number  of  circuits 

1th  Individual  clrcult/channel  reliability 
percentage 

/Time  1th  clrcult/channel  Is 

*of  traffic  Quality 

Demand  usage  time 
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(NOTE:  P7  expresses  the  success  of  the  FCS  In  maintaining  teletype 
circuits  of  traffic  quality.) 

ASSUMPTION:  A reliable  traffic  quality  circuit  Is  a circuit  condition  of  15X 
or  less  black  bias  distortion  and  the  MPOS  receiving  messages  of  sufficient 
quality  to  process. 

REFERENCE:  Final  Report  on  Project  X/S7 

"Conduct  an  Operational  Assist  for  CVAN  68  Message  Processing 
and  Distribution  System  (MPDS)/Fac1 1 1 ties  Control  System  (FCS)" 
29  Nov.  1972,  CONF. 
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TABLE  B-2  Operational  Test  4 Evaluation 
MOE  Data  Base  (Continued) 


Area;  Data  4 Display  (DP) 


CODE 

ITEM 

DD1 

Naval  Tactical  Data  System  (NTDS) 

DD2 

Computer  Controlled  Commard  and  Control 
System  (DATACOURTS) 

DD3 

Antisubmarine  Contact  Analysis  Center 
(ASCAC ) 

DD4 

ASW  Avionics  System  (ANEW) 

DD5 

Electronic  Display  System  (EDS) 

DD6 

Teletype  Integrated  Display  System 
(TIDY) 

DD7 

Data  Relay  System 
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DATA  & DISPLAY  (DP) 

s 

DPI  - Naval  Tactical  Data  System  (NT PS) 

DESCRIPTION:  This  is  a computerized  tactical  control  system  which  is 
designed  to  collect,  exchange,  process  and  evaluate  information  in  an 
anti-air  warfare  situation. 

(1)  SPECIFIC  OBJECTIVE:  Determine  the  accuracy  of  the  system  to  depict 
the  location  of  a given  air  target  using  three  NTDS-equIpped  ships. 

(MOE)^  * Accuracy  with  which  the  system  (based  on  3 ships) 

Is  able  to  locate  a given  target  as  compared  to  the 
position  determined  by  a precision  radar  tracking 
system  used  as  a standard 

(NOTE:  A measure  of  this  accuracy  would  be  either  the 
average  50^  or  the  90^  percentile  radius  of  a circle 
centered  on  the  actual  positions  which  would  enclose  the 
three  NTDS  positions.) 

(M0E)2  * Position  radius  of  the  NTDS  target  among  the  three 
NTDS  ships,  which  Is  defined  as  the  radius  of  the 
smallest  circle  which  will  enclose  all  three  NTDS 
symbol  positions 

(NOTE:  This  is  a measure  of  the  relative  accuracy  of  position 
of  a NTOS  target  Independent  of  an  outside  reference  system.) 

REFERENCE:  Final  Report  on  the  Naval  Tactical  Data  System  Service  Test 
Part  III  Materiel  Aspects  of  the  Service  Test  Equipment 
Task  IV  of  Phase  II,  Project  C/S5  FY60 

"Concurrent  Evaluation  of  the  Naval  Tactical  Data  System  (NTDS)" 
18  Sept.  1962,  CONF. 
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002  - Computer  Controlled  Command, and  Control  System 

DESCRIPTION:  This  system  Is  designed  to  unite  the  ship's  sensors  and 
weapon  systems.  It  consists  of  a general  purpose  digital  computer,  an 
Evaluation  Display  and  Control  Console,  a Teletype  and  Paper  Tape  Reader. 

(1)  SPECIFIC  OBJECTIVE:  Evaluate  sensor  alerting  capability. 

(MOE ) ^ » Probability  of  ESM  (Electronic  Warfare  Support 

Measures)  detection  causing  an  alert 

/Number  of  times  ESM  detection  was  successful) 

3 ‘ In  causing  an  alert  to  the  proper  sensor  / 

/Number  of1  alert  attempts  due  to  ESM) 

Vdetectlon  ' 

(MOEjg  ■ Probability  of  search  radar  detection  causing  an 
alert 

(Number  of  times  search  radar  detection  was\ 
successful  In  causing  an  alert  to  the  ) 

_ proper  sensor/sensors / 

" /Number  of  alert  attempts  due  to  search] 

V radar  detection  t 

(MOE ) ^ * Probability  of  evaluator  Input  causing  an  alert 

/Number  of  times  evaluator  inputs  were  success-) 

„ ' ful  at  alerting  ESM  and/or  search  radars 

/Number  of  alert  attempts  due  to) 

\ evaluator  Inputs  ' 

ASSUMPTIONS: 

(1)  When  one  sensor  notifies  this  C&C  system  that  Is  has  detected 
a target,  the  system  evaluates  the  sensor  In  relation  to  the 
threat.  If  this  sensor  does  not  provide  sufficient  Information, 
Is  not  the  best  sensor  for  the  threat,  or  If  the  sensor  Is  over- 
loaded, another  sensor  Is  alerted  to  track  the  threat.  If  an 
alert  to  any  sensor  Is  not  responded  to  f**om  that  sensor  by  an 
entry,  the  system  will  continue  alerting  the  sensor  until  It 
does  receive  a reply  entry. 

(2)  The  evaluator  can  cause  alerts  when  he  acts  as  Initial  detector, 
designates  to  a reaction  system,  or  deletes  a target  from  the 
system. 
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(2)  SPECIFIC' OBJECTIVE:  Evaluate  capability  to  correlate  sensor  Inputs. 


(MOE)1 


Probability  of  successful  search  radar-to-search 
radar  correlation 

/Number  of  times  search  radar-to-search  radar' 

'correlation  Is  achieved 

/Number  of  search  radar-to-search  radar\ 
'correlation  attempts  > 


(MOEjg  * Probability  of  successful  ESM-to-search  radar 
correlation 

/Number  of  times  ESM-to-search  radar\ 

'correlation  is  achieved / 

/Number  of  ESM-to-search  radar' 

'correlation  attempts  ' 

(MOE)3  * Probability  of  successful  FCS  (Fire  Control 

System)  lock-on-to-search  radar  correlation 

/Number  of  times  FCS  lock-on-to-search  radar' 

'correlation  Is  achieved  

/Number  o^  FCS  lock-on-to-search  radar) 
'correlation  attempts  ' 


(NOTE:  (M0E)1 , (M0E)2  and  (MOE )3  are  measures  of  search 

radar  correlation  success.) 


(M0E)4  « Probability  of  successful  search  radar-to-ESM 
correlation 

/Number  of  times  search  radar-to-ESM) 

B correlation  is  achieved 

/Number  of  search  radar-to-ESM) 

'correlation  attempts  ' 

(MOE)g  ■ Probability  of  successful  FCS  lock-on-to-ESM 
correlation 

/Number  of  times  FCS  lock-on-to-ESM\ 

, 'correlation  Is  achieved t 

/Number  of  PCS  lock-on-to-ESM) 

'correlation  attempts  / 

(NOTE:  (M0E)4  and  (M0E)g  are  measures  of  ESM  correlation 

success.) 
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(MOE)g  ■ Probability  of  successful  search  radar-to-FCS 
lock-on  correlation 

/Number  of  times  search  radar-to-FCS  lock-on \ 

x 'correlation  Is  achieved  / 

/Number  of  search  radar-to-FCS  lock-on\ 
'correlation  attempts  / 

(MOE )y  * Probability  of  successful  ESM-to-FCS  lock-on 
correlation 

/Number  of  times  ESM-to-FCS  lock-on\ 

_ 'correlation  Is  achieved 

* /Number  of  ESM-to-FCS  lock-on\ 

'correlation  attempts  / 

(MOE)g  - Probability  of  successful  FCS-to-FCS 

lock-on  correlation 

/Number  of  times  FCS-to-FCS  lock-on\ 

m 'correlation  Is  achieved /_ 

/Number  of*  FCS-to-FCS  lock-on\ 

'correlation  attempts  ' 

(NOTE:  (MOE)g,  (M0E)7  and  (M0E)Q  are  measures  of  fire 

control  system  correlation  success.) 


(MOE)  * Probability  of  evaluator  correlation  success 

q 

/Number  of  threats  Initially  entered  by  the\ 
(evaluator  and  subsequently  entered  by  a ) 

u \ search  radar / 

/Number  of  threats  Initially  entered  by) 

'the  evaluator  / 


ASSUMPTIONS; 

(1)  As  each  new  entry  arrives  in  the  system,  It  Is  compared  with 
all  existing  Items  In  the  threat  file.  If  the  new  entry  Is 
within  the  prescribed  correlation  bins  In  range  and  bearing,  and 
if  the  classification  Is  consistent  with  the  classification  In 
the  threat  file,  then  the  two  Items  are  said  to  correlate. 

(2)  Search  radar  correlation  success  Is  assumed  to  occur  when  the 
threat  file  track  Is  Initiated  by  a search  radar  entry  and  a 
new  Input  Is  received  from  another  search  radar,  ESM,  or  FCS 
lock-on. 


B-46 


D02 


(3)  ESM  correlation  success  Is  assumed  to  occur  when  the  threat  file 
track  Is  Initiated  by  an  ESM  entry  and  a new  Input  Is  received 
from  either  a search  radar  or  a FCS  lock-on. 

(4)  Fire  control  system  correlation  success  Is  assumed  to  occur  when 
the  threat  file  track  Is  being  updated  by  a FCS  and  search  radar 
enters  a new  track,  ESM  enters  a bearing  and  classification,  or 
another  FCS  locks  on  the  same  target. 


(3)  SPECIFIC  OBJECTIVE:  Evaluate  weapons  system  engagement  capability. 


(M0E)<|  * Probability  of  successful  engagement 

a Number  of  threats  effectively  engaged 
Number  of  threats  detected 

(MOE^  * Median  total  reaction  time 

* RDA  + RARF  + RRFF 

where 

Rqa  ■ median  reaction  time  from  detection  to  assign 
RARP»  median  reaction  time  from  assign  to  ready- 
to-flre 

RRPP«  median  reaction  time  from  ready-to-flre  to 
fire 


REFERENCE:  Final  Report  on  Project  C/S68 

"Conduct  a Concurrent  Evaluation  of  ASML)  (Anti -Ship  Missile 
Defense)  Near  Term  Program  Equipments  DATACOURTS  (Data 
Correlation  and  Transfer  System)  Portion" 

17  Oct.  1972,  SECRET 
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003  - Antisubmarine  Contact  Analysis  Center  (ASCAC) 

DESCRIPTION:  This  Is  a system  using  specially  configured  analysis  equipment 
and  specially  trained  personnel  (called  the  Antisubmarine  Contact  Team 
(ASCAT))  to  process  and  Interpret  raw  sonic  Intelligence  received  via  radio 
link  or  other  means  from  airborne,  surface  and  subsurface  sensors. 

(1)  SPECIFIC  OBJECTIVE:  Evaluate  the  ability  of  the  ASCAT  and/or  sensors 
to  classify  contacts. 

(MOE)^  ■ Percent  correct  classifications 

/Number  of  correctly  classified1 

^signatures inn 

/Number  of  classification}  x uu 

' opportunities  • 

(HOE * Median  time  for  classification 


REFERENCE:  Final  Report  on  Project  F/0  117 

"Fleet  Operational  Investigation  of  a CVS  Antisubmarine  Contact 
Analysis  Center  (ASCAC)" 

11  July  1963,  SECRET 


1 

1 

I 

I 

I 

I 

1 

I 


v, 
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0D4  - ASW  Avionics  System 

DESCRIPTION:  This  system  consists  of  Integrated  navigation,  communications , 
sensor,  display,  maintenance,  ordnance  and  data  processing  subsystems. 

(1)  SPECIFIC  OBJECTIVE:  Evaluate  the  capability  of  an  aircraft  equipped 
with  this  system  to  perform  detection,  classification,  localization 
and  attack  operations. 


(HOE) 


1 


(MOE), 


(MOE). 


(HOE), 


(HOE), 


(MOE). 


(MOE). 


(MOE) 


8 


Average  time  to  detect/classify,  which  Is  the 
average  of  times  from  the  first  detection  oppor- 
tunity until  a valid  target  detection  was 
announced  by  a sensor  operator 
Average  time  from  detection  to  attack,  which  Is 
defined  as  the  average  of  times  from  the  first 
valid  detection  until  a simulated  attack  was 
delivered  against  the  target 

Average  time  to  attack  for  short  range  localization, 
which  Is  defined  as  the  average  of  times  from  the 
first  valid  contact  by  Julie,  active  sonobuoy  or 
MAO  until  a simulated  attack  was  delivered  against 
the  target 

Average  total  time  to  attack,  which  Is  defined  as 
the  average  of  times  from  the  first  detection 
opportunity  to  the  time  of  delivery  of  a simulated 
attack 

Lofar  detection/opportunity  ratio 

Number  of  events  with  valid  Lofar  detections 
Number  of  events  con  Inlng  a valid  opportunity 

Valid  classification/total  classification  ratio 

Number  of  valid  target  submarine  classifications 
Number  of  announced  target  submarine  classifications 

Successful  attack/short  range  localization  ratio 

/Number  of  successful  attacks,  given  a\ 

\short  range  sensor  contact  / 

/Number  of  events  with  a valid  Julie, \ 

'active  sonobuoy  or  MAO  contact  ' 

Successful  attack/total  attack  ratio 

Number  of  successful  attacks 
Number  of  attacks  conducted 
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(MOE)g  » Successful  attack/total  event  ratio 

m Number  of  successful  attacks 
Number  of  events  conducted 

(M0L)10-  Probability  of  successful  attack 

(NOTE:  (HOE)^q  Is  computed  via  a detailed  Markov  chain 
model  described  In  an  enclosure.) 

REFERENCE:  Final  Report  on  Project  F/0228 

"Fleet  Operational  Investigation  to  Establish  the  Effective- 
ness of  the  P-3  ANEW  Compared  to  the  OELTIC  P-3A/B" 

31  Oct.  1967,  CONF. 
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OD5  - Electronic  Display  System 

DESCRIPTION:  This  Is  a data  handling,  display  and  exchange  system  used 
In  fleet  air  defense  to  provide  data  link  exchange  or  detection  and 
tracking  Information  on  airborne  targets. 

(1)  SPECIFIC  OBJECTIVE:  Evaluate  accuracy  capability  against  air  targets. 

(MOE)^  ■ Percent  of  total  number  of  valid  tracks  as  a 
function  of  store  tracking  error  (deg) 

(M0E>2  ■ Percent  of  total  number  of  valid  tracks  as  a 
/unction  of  store  speed  error  (kts) 

(M0E)3  * Percent  of  total  number  of  valid  tracks  as  a 
function  of  maximum  separation  of  tracks  (nm) 

REFERENCE:  Final  Report  on  Project  0P/S480/S67 

"Evaluation  of  the  Electronic  Data  System  (EDS)" 

1 1960,  UNCL. 
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DD6  - Teletype  Integrated  Olsolav  System  (TIDY) 

DESCRIPTION:  This  Is  a small-scale  data  processing  system  designed  to 
Improve  current  methods  of  displaying  the  tactical  data  available  from 
the  NTDS  Link  14. 

(1)  SPECIFIC  OBJECTIVE:  Determine  plot  accuracy. 

(MOE)^  ■ Percent  range  accuracy 

■ 100%  - % absolute  range  error 

(MOE)g  ■ Cumulative  distribution  of  absolute  range 
error  as  a percent  of  range  scale 

(2)  SPECIFIC  OBJECTIVE:  Determine  capability  of  the  TIDY  computer  to 
accurately  maintain  the  navigational  position  of  own  ship  (OS)  with 
respect  to  Data 'Link  Reference  Point  (DLRP). 

(M0E)1  ■ Average  navigation  error  rate  (nm/hr) 

(M0E>2  ■ Maximum  navigation  error  rate  (nm/hr) 

(HOE) j * Maximum  navigation  error  (nm) 

(3)  SPECIFIC  OBJECTIVE:  Determine  track  processing  capability. 

(MOE)^  ■ Average  actions  per  minute  (APM) 

/Number  of  actions  which  took  p1ace\ 

, Vln  a given  Interval  

~ Interval  Length 

(NOTE:  The  "actions"  consist  of  new  tracks  which 
appear  on  the  plot,  old  tracks  which  are  dropped, 
and  those  tracks  that  are  updated.  This  APM  figure 
does  not  necessarily  represent  the  true  number  of 
actions  during  the  Interval  due  to  the  possibility 
that  a particular  track  may  have  been  added  or 
updated  and  then  dropped,  or  It  may  have  been 
updated  once  and  then,  upon  a second  update,  the 
symbol  may  have  been  moved  with  all  previous  data 
scrubbed  from  the  plot  board.) 
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(HOE )p  « Plot  track  ratio 

/Number  of  plot  positions  appearing  on\ 

'the  Suninary  Plot / 

* Total  number  of  tracks 

(NOTE:  (MOE)2  Is  a measure  of  track  coherency.) 

REFERENCE:  Final  Report  on  Project  0/S179 

"Operational  Evaluation  of  the  TIDY  (Teletype  Integrated 
Display  System)" 

10  May  1973,  CONF. 
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D07  - Data  Relay  System 

DESCRIPTION:  This  system  Is  designed  to  provide  a two  way  radio  link  for 
Intermittent  exchange  of  sonic  data  between  an  aircraft  and  elements  of 
SOSUS.  The  system  provides  a side  by  side  display  of  sonobuoy  and  Sound 
Search  Station  (SOSS)  data  on  either  the  SOSS  or  aircraft  display  equipments. 

(1)  SPECIFIC  OBJECTIVE:  Evaluate  operator  classification  capability. 

(MOE)^  ■ Percent  correct  classifications  as  submarine  or 
non-  submarine 

. Number  of  correct  classifications  , 00 

* Number  of  classification  opportunities  x 

(MOE )2  * Percent  friendly  targets  correctly  recognized 

/Number  of  friendly  targets\ 

. 'correctly  recognized  / 1Q0 

/Number  of  friendly  target  \ 

'classification  opportunities/ 

(MOE) ^ ■ Percent  unfriendly  targets  correctly 

recognized 

/Number  of  unfriendly  targets\ 

, 'correctly  recognized lnn 

/flumber  of  unfriendly  target  \ x uu 

'classification  opportunities/ 

(MOE)4  ■ Average  classification  time  per  operator 

(MOE)g  ■ Difficulty  Index  for  submarine  or  non-submarine 

decision 

/Number  of  correct  operator  decisions  as\ 

, 'submarine  or  non-submarine  / 

/Number  of  operators  classifying  the\ 

'signature  / 

(MOE)g  ■ Difficulty  Index  for  friendly  or  non-friendly 

decision 

/Number  of  correct  operator  decisions  as\ 

, 'friendly  or  non-friendly  / 

/Number  of  operators  classifying  the\ 

'signature  ' 


(MOE)7  ■ Difficulty  Index  for  conventional  or  nuclear 
powered  decision 

/Number  of  correct  operator  decisions) 
j \as  conventional  or  nuclear  powered  ' 

“ /Number  of  operators  classifying  the) 
'signature  > 

REFERENCES;  (1)  Final  Report  on  Project  F/0116  FY62 
(Title  Classified) 

15  Oct.  1963,  SECRET 

(2)  Supplementary  Report  on  Project  F/0116  FY62 
(Title  Classified) 

23  Jan.  1964,  SECRET 
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TABLE  B-2  Operational  Test  & Evaluation 
HOE  Oata  Base  (Continued) 


Area;  Electromagnetic  Detection  & Countermeasures  (EDC) 


COPE 

ITEM 

E0C1 

Radar 

EDC 1-1 

Air  Search  Radar  (AN/SPS-49(XN-1 ), 
AN/SPS-50  (XN-1 ) , AN/SPS-52, 
AN/SPS-58) 

EDC1-2 

Air  Traffic  Control  Radar  (AN/SPN-43) 

EDC1-3 

Airborne  Early  Warning  Radar 

EDC  2 

IFF  System  (AN/SLQ-20,  AN/UPX-24) 

EDC3 

Target  Recognition  Set  (AN/ ASX-2  (TRISAT)) 

EDC4 

Mine  Control  Wire  Detector 
(L  Mk  3X  Mod  0 Locator  (RADRAG)) 

EDC  5 

Early  Warning  and  Surveillance  Receiver 
(AN/WLR-8(V)2  ESM  Receiver) 

EDC6 

Minesweeping  Equipment  (Mk  105  Mod  0, 
Mk  104  Mod  1) 

EDC  7 

Mine  Defense  System  (SHADOWGRAPH) 

EDC8 

Degaussing  System 

EDC9 

Automatic  Permanent  Magnetic  Compensator 
(APMC) 

EDC10 

MAD  Device  (AN/ASQ-8) 

EDC11 

Electronic  Warfare  System  (AN/SLQ-27 
(XN-1)  SHORTSTOP) 

EDC12 

ECM  Receiving  Antenna  (AS-899/SLR) 

EDC  13 

Shipboard  Direction  Finding  System 
(AN/SRD-19  (XN-1)) 

FDC14 

Radio  Direction  Finder  (AN/BRD-7) 

EDC15 

Radio  Frequency  Oscillator  (RFO) 
(0-1331  (XN-1 )/ULQ-6) 

EDC  16 

Deception  Repeater  (AN/SLQ-1 7(V ) ) 

EDC17 

Aircraft  Radar/Ml sslle  Homing  and 
Warning  Receiver 
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Area:  Electromagnetic  Detection  & Countermeasures  (EDC)  (Continued) 


CODE 

ITEM 

EDC  18 

Radio  Frequency  Amplifier 
(AM-4530/ULQ-6A) 

EDC19 

Decoy  Repeater  Buoy  (AN/ULQ-5) 

EDC20 

Noise  Jammer  (ALT-27) 
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ELECTROMAGNETIC  DETECTION  & COUNTERMEASURES  (EDC) 


EDC1  - Radar 

EDC1-1  Air  search  radar 

DESCRIPTION:  This  system  Is  a shipboard  air  search  radar  designed  for 
operation  In  the  presence  of  countermeasures. 

(1)  SPECIFIC  OBJECTIVE:  Evaluate  radar  detection  performance. 

(M0E).j  » Cumulative  distribution  of  maximum  detection  range, 

1 . e . • percent  of  runs  on  which  detection  was  made 
by  given  range 

(MOEjg  * Single  scan  probability  of  detection  as  a function  of 
range  for  given  target  speed,  target  altitude  and 
antenna  loblng 

m Number  of  detections  (blips) 

Number  of  scans 

(MOE) ^ ■ Median  detection  range  for  given  radar  mode,  target 
type  and  target  altitude 

(M0E)4  * 90*  cumulative  detection  range  for  given  radar  mode, 
target  type  and  target  altitude. 

(MOE)g  ■ Median  minimum  detection  range  for  given  target 
altitude  and  elevation  scan  limit 

ASSUMPTION:  Two  types  of  detection  criteria  employed  for  computa- 
tion of  (MOE)^  were:  (1)  first  detection  of  an  Incoming  aircraft  by 
an  alerted  operator,  and  (2)  observation  of  two  blips  In  any  three 
consecutive  scans.  Use  of  the  second  criterion  reduced  the  Influence 
of  random,  strong,  noise  returns  with  characteristics  similar  to 
aircraft  target  returns,  and  more  closely  approximated  the  detection 
decision  point  of  an  unalerted  operator. 

(2)  SPECIFIC  OBJECTIVE:  Evaluate  radar  tracking  performance. 

(M0E).|  = Percent  of  runs  on  which  tracking  was  held  to  a given 
range 

(MOEjg  ■ Average  Index  of  track  solidity  as  a function  of  slant 

range  for  given  target  altitude  and  video  category,  which 
Is  defined  as  the  ratio  of  blips  observed  to  the  total 
number  of  scans  within  a specified  range  band 
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(3)  SPECIFIC  OBJECTIVE:  Evaluate  radar  capability  to  estimate  target 
posltlon/locatlon. 

{MOE)1  ■ Cumulative  range  error  distribution 
(H0E)2  * Cumulative  bearing  error  distribution 
(MOE)^  ■ Cumulative  altitude  error  distribution 
(MOE)^  * Mean  bearing  resolution  for  target  within  given 
range  band 

(4)  SPECIFIC  OBJECTIVE:  Evaluate  capability  of  system  to  perform 
control  of  air  Intercepts. 

HOC  r Probability  of  successful  Intercept 

, Number  of  successful  Intercepts 
* Number  of  intercept  attempts 

(5)  SPECIFIC  OBJECTIVE:  Evaluate  the  capability  of  the  system  to  provide 
interface  with  the  Weapons  Designation  Equipment  (WDE). 

MOE  ■ Mean  acquisition  time 

REFERENCES:  (1)  Final  Report  on  Project  C/S34 

"Concurrent  Evaluation  of  AN/SPS-49(XN-1 ) and  AN/SPS-50(XN-1 )" 
7 Feb.  1965,  CJNF. 

(2)  Final  Report  on  Project  C/S46 

''Conduct  a Concurrent  Evaluation  of  the  AN/SPS-52  Radar" 

25  -larch  1970,  CONF. 

(3)  Final  Report  on  Project  C/S72 

"Conduct  a Concurrent  Evaluation  of  the  AN/SPS-58  Radar 
System" 

27  July  1971,  CONF. 

EDC1-2  Air  traffic  control  radar 

DESCRIPTION:  This  shipboard  system  Is  a medium  range,  two-coordinate  CATC 
(Carrier  Air  Traffic  Control)  radar. 

(1)  SPECIFIC  OBJECTIVE:  Determine  radar  detection  and  tracking  performance. 

(MOE) i ■ Average  Index  of  track  solidity  as  a function  of  slant 
range  for  given  target  altitude,  target  type  and  antenna 
tilt  angle 
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(MOE )2  * Mean  radar  range  resolution,  where  range  resolution 
Is  based  on  the  range  difference  of  the  leading  edge 
of  two  targets  at  the  same  bearing  as  the  two  target 
blips  started  to  separate  or  merge 

(MOEJj  » Mean  radar  bearing  resolution,  where  bearing  resolu- 
tion Is  based  on  the  bearing  difference  of  the  center 
of  two  targets  at  the  same  range  as  the  two  target 
blips  started  to  separate  or  merge 

(MOE)^  » Mean  radar  range  error 

(MOE) 5 ■ Mean  radar  bearing  error 

(MOE)g  » Average  minimum  target  detection  range  as  a function 
of  target  altitude,  target  type,  antenna  polarization 
type  and  antenna  tilt  angle 

(MOE) 7 * Average  maximum  target  detection  range  as  a function 
of  target  altitude,  target  type,  antenna  polariza- 
tion type  and  antenna  tilt  angle 

REFERENCE:  Final  Report  on  Prcject  0/S123 

"Conduct  an  Operational  Evaluation  of  the  Improved  AN/SPN-43" 
7 Sept.  1967,  CONF. 

EDC1 -3  Airborne  early  warning  radar 

DESCRIPTION:  This  system  Is  designed  to  detect,  identify  and  track  air- 
borne (overland  and  overwater)  and  surface  targets. 

(1)  SPECIFIC  OBJECTIVE:  Determine  the  capability  to  detect,  Identify 
(IFF)  and  track  targets 

(MOE)^  * Blip/scan  ratio  as  a function  of  range 
for  given  target  type,  altitude,  speed 
and  radar  mode 

(Number  of  times  target  radar  return  \ 
was  present  on  the  scope  for  a given) 

range  band / 

/Number  of  antenna  scans  In  a g1ven\ 

\ range  band  / 
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(MGL)p  - Probability  of  successful  target  aircraft 

Identification 

. Number  of  valid  replies 
" Number  o^  IFF  interrogations 

(2)  SPECIFIC  OBJECTIVE:  Determine  the  capability  of  the  passive  detection 
system  (PDS)  to  fix  stationary  electromagnetic  emitters. 

MOE  « Circular  error  probable  (CEP)  of  emitter  site  position 

REFERENCE:  First  Partial  Report  on  Project  C/V22 

"Conduct  a Concurrent  Evaluation  of  the  E-2C  Weapon  System" 

19  April  1973,  SECRET 
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EDC2  - IFF  System 

DESCRIPTION:  An  IFF  system,  as  part  of  a radar  system,  Is  designed  for 
Interrogating  and  Identifying  aircraft. 

1 1 ; OBJfcUIVt.  Evaluate  system  ability  to  identify  aircraft. 

MOE  ■ Single  scan  probability  of  detection  as  a function  of 
target  range  and  azimuth  separation  of  target  aircraft 

m Number  of  aircraft  Identifications 
Number  of  radar  scans 

(2)  SPECIFIC  OBJECTIVE:  Evaluate  detection  capability. 

(M0E).|  ■ Probability  of  aircraft  detection 

Number  of  detections 

Number  of  detection  opportunities 

(MOE )2  * Percent  of  warning  alerts  detected  or  confirmed 

/Number  of  warning  a1erts\ 

_ v detected  or  confirmed  / w lnn 
Number  o^  warning  alerts  00 

REFERENCES:  (1)  Final  Report  on  Project  P/S3 

"Conduct  an  Operational  Appraisal  of  SEESAW  II  (AN/SLQ-20)" 
2 Feb.  1970,  SECRET 
(2)  Final  Report  on  Project  C/S82 

"Conduct  a Concurrent  Evaluation  of  the  AN/UPX-24  Central 
IFF  System" 

17  Oct.  1973,  CONF. 
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EDC3  - Target  Recognition  Set 

DESCRIPTION:  The  TRISAT  (Target  Recognition  Through  Integral  Spectral 
Analysis  Techniques)  recognition  set  Is  used  to  recognize  jet  aircraft 
engines. 

(1)  SPECIFIC  OBJECTIVE:  Evaluate  the  ability  of  the  system  to  correctly 
Identify  (l.e.,  classify)  programmed  aircraft  targets. 

(MOE)^  ■ Probability  of  target  correct  classification 

» Number  of  targets  correctly  classified 
Number  of  runs  against  programmed  targets 

(M0E)2  * Classification  range  as  a function  of  track  Initiation 

range 

(MOE)j  ■ Average  low  confidence  classification  range 
(MOE)^  a Average  high  confidence  classification  range 

REFERENCE:  Summary  Report  of  Project  X/V17 

"Conduct  an  Operational  Assist  for  the  AN/ASX-2  (TRISAT) 
Recognition  Set" 

17  Oct.  1972,  SECRET 
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EDC4  - Mine  Control  Wire  Detector 

DESCRIPTION:  This  system  Is  designed  to  detect  control  wires  leading  to 
conmand-detonated  mines. 

(1)  SPECIFIC  OBJECTIVE:  Evaluate  detection  performance. 

(MOE)^  ■ Probability  of  successfully  detecting  a mine  wire 

. Number  of  successes 
Number  of  opportunities 

(MOE ) g ■ False  alarm  rate 

B Number  of  false  alarms  reported 
Number  ol  miles  swept 

REFERENCE:  Final  Report  on  Project  0/S178 

"Conduct  an  Operational  Evaluation  of  the  L Mk  3X  Mod  0 
Locator  (RADRAG)" 

22  June  1973,  CONF. 
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EDC5  - Early  Warning  and  Surveillance  Receiver 

DESCRIPTION:  This  device  Is  designed  as  a tactical  early  warning  and 
surveillance  receiver  for  submarine  use. 

(1 ) SPECIFIC  OBJECTIVE:  Evaluate  detection  performance. 

(M0E)1  * Average  operator  Integration  time  as  a function  of  frequency 
(M0E)£  ■ Maximum  detection  range 

ASSUMPTION:  Integration  time  was  measured  from  the  time  of  signal 
Intercept  to  the  time  of  completed  analysis. 

(2)  SPECIFIC  OBJECTIVE:  Evaluate  system  accuracy. 

(MOE) i ■ Mean  percentage  error  In  frequency 

« Actual  frequency  “ Observed  frequency  . QQ 
" Actual  frequency 

(MOE) 2 * Mean  percentage  error  In  PW  (pulse  width) 

_ Actual  PW  - Observed  PW  .. 

Actual  W * 100 

(M0E)3  ■ Mean  percentage  error  In  PRF  (pulse  repetition  frequency) 

_ Actual  PRF  - Observed  PRF  .. 

Actual ' WF x 100 

(MOE )^  ■ Mean  bearing  error  (deg) 

(3)  SPECIFIC  OBJECTIVE:  Evaluate  ability  to  Intercept  signals. 

MOE  ■ Probability  of  signal  Intercept 

> Actual  Intercepts 
Attempted  Intercepts 

REFERENCE:  Final  Report  on  Project  C/S94 

"Conduct  a Concurrent  Evaluation  of  the  AN/WLR-8(V)2  ESM 
Receiver" 

26  Oct.  1973,  SECRET 
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EDC6  - Mlnesweeolng  Equipment 

DESCRIPTION:  This  Is  a helicopter  towed,  unmanned  device  designed  to  counter 
magnetic,  acoustic  or  combination  magnetic-acoustic  sea  mines  that  present 
a hazard  to  conventional  minesweepers  and  amphibious  craft. 

(1)  SPECIFIC  OBJECTIVE:  Evaluate  the  capability  to  sweep  mines. 

(M0£)i  ■ Probability  of  actuation  as  a function  of  lateral 
range 

/Number  of  mines  actuated  In  a\ 

b \ given  range  band /__ 

" /Number  of  runs  in  a g1ven\ 

'range  band  ' 

(MOE )2  * Aggregate  sweep  width,  which  Is  defined  as 

twice  the  area  under  the  probability  of 

actuation  versus  lateral  range  curve 

(MOc)j  > Maximum  sweep  (actuation)  range 

(2)  SPECIFIC  OBJECTIVE:  Evaluate  the  vulnerability  of  the  helicopter  and 
minesweeping  platform  to  mine  actuations. 

MOE  ■ Damage  probability 

/Number  of  actuations  causing  pijme  \ 
a vdamaqe  to  the  helicopter  or  platform/ 

(Number  of  actuations  where  tne  hel1-\ 
copter's  or  platform's  closest  point  ) 
of  approach  Is  less  than  the  plume's/ 
projected  radius 

ASSUMPTION:  If  the  plume  of  the  actuated  mine  touched  either  the 
helicopter  or  platform,  damage  Is  assumed  to  occur. 

REFERENCE:  Final  Report  on  Project  0/V71 

"Conduct  an  Operational  Evaluation  of  the  Magnetic  Minesweeping 
Gear  Mk  105  Mod  0 and  the  Combined  Magnetic  (Mk  105  Mod  0)  — 
Acoustic  (Mk  104  Mod  1)  Minesweeping  Gear,  PAGE" 

19  August  1970,  SECRET 
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EDC7  - Mine  Defense  System 


DESCRIPTION:  This  system  Is  designed  to  locate,  classify  and  destroy 
bottom  mines.  It  consists  of  a classification  subsystem,  using  under- 
water classification  vehicles  and  associated  shipboard  display  and  control 
facilities,  a precise  navigation  subsystem,  an  automatic  plotting  sub- 
system and  a mine  neutralization  subsystem. 

(1)  SPECIFIC  OBJECTIVE:  Determine  classification  subsystem  capability 
to  locate  and  classify  mines. 


(HOE), 

(M0E)2 

(moe)3 

(M0E)4 

(moe)5 


Mine  and  non-mine  detection  probability 

/Number  of  detections  of  mines' 

'and  non-mines  /_ 

/Number  of  detection' 

'opportunities  / 

Mine  detection  probability 

Number  of  mine  detections 
/Number  of  detection  \ 

'opportunities  for  mines/ 

Probability  of  classifying  a mine  correctly 

Number  of  mines  correctly  classified 
Number  ol*  mine  detections 


Probability  of  classifying  a non-mine  correctly 

/Number  of  known  non-mines  correctly' 

'classified !__ 

/Number  of  opportunities  to  classify' 

'known  non-mine  targets  / 

Average  time  to  locate  and  classify  mines 


(2)  SPECIFIC  OBJECTIVE:  Determine  system  capability  to  neutralize  and 


clear  minefields. 


(MOE),  * Average  diving  time  per  mine  for  neutralization 

(M0E)2  * Average  time  to  locate,  classify  and  neutralize 

mines  In  a minefield  of  specified  size 

(M0E)3  « Clearance  rate,  i.e.,  area  neutralized  per  hour 

(M0E)4  ■ Percent  mines  neutralized 

_ Number  of  mines  neutralized 
(TiiEeVoV  mines  In  TTeTH * 100 


REFERENCE:  Final  Report  on  Project  F/096  FV62 

"Fleet  Operational  Investigation  of  Mine  Defense  System  S-101 
(SHADOWGRAPH)" 

4 Jan.  1963,  SECRET 
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EDC8  - Degaussing  System 

DESCRIPTION:  Miniaturized  degaussing  system  for  use  In  submarines. 

(1)  SPECIFIC  OBJECTIVE:  Determine  reduction  In  the  magnetic  field/ 
signature  of  submarines  using  a degaussing  system. 

(MOE)^  « Percent  reduction  In  average  MAD  detection  range 
(M0E)2  ■ Percent  reduction  In  average  magnetic  mine  actuation 
distance 

REFERENCE:  Final  Report  on  Project  C/Sll  FY  61 

"Concurrent  Evaluation  of  a Miniaturized  Degaussing  System 
for  Use  In  Submarines" 

14  Aug.  1962,  CONF. 


B-68 


EDC9 


EDC9  - Automatic  Permanent  Magnetic  Compensator  (APMC) 

DESCRIPTION:  This  equipment  Is  designed  for  use  In  aircraft  equipped 
with  Inboard  NAD  equipment  and  to  enable  automatic  permanent  magnetic 
field  compensation  by  semlautomatlcally  adjusting  and  then  maintaining 
the  current  In  the  compensating  coll  assembly. 

(1)  SPECIFIC  OBJECTIVE:  Determine  the  capability  to  provide  Improved 
permanent  magnetic  compensation. 

(HOE)-j  ■ Flgure-of -merit  (FOM),  which  Is  the  sum,  disregarding 
polarity,  of  the  maneuver  averaged  noise  signals,  In 
gammas,  generated  during  a NAD  noise  box  (l.e.,  the 
procedure  for  determining  MAD  maneuver  signal  noise 
levels). 

(NOTE:  FOM  Is  an  Indication  of  the  overall  degree  of  com- 
pensation.) 

(MOE)2  * Average  slant  detection  range 

(MOE)^  * Average  time  required  to  perform  a complete  APMC 

compensation  of  the  permanent  magnetic  field  of  the 
aircraft 

REFERENCE:  Final  Report  on  Project  F/0151  FY64 

"Fleet  Operational  Investigation  of  Automatic  Permanent 
Magnetic  Field  Compensator" 

2 June  1964,  CONF. 
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EDC10  - MAD  Device 

DESCRIPTION:  This  equipment  Is  essentially  a highly  sensitive  airborne 

magnetometer  designed  to  detect  the  magnetic  field  of  a submerged  sub- 
marine from  low  flying  aircraft. 

(1)  SPECIFIC  OBJECTIVE:  Evaluate  detection  capability  against  submarines. 

(MOb)i  ■ Average  slant  range  of  detection 

(M0E)2  ■ Sweep  width 

(NOE >2  * Probability  of  detection  of  a submarine  pene- 
trating a standard  trapping  circle  as  a function 
of  submarine  speed  and  vertical  separation  between 
aircraft  and  submarine 

B Number  of  detections 

fi3ber  of  detection  attempts 

ASSUMPTIONS: 

(1)  When  an  aircraft  attempts  magnetic  detection  of  a submarine,  the 
distance  between  the  aircraft  and  the  submarine  at  the  point  of 
closest  approach  Is  regarded  as  the  slant  range. 

(2)  Average  detection  range  Is  the  maximum  range  at  which,  on  the 
average,  detection  can  be  obtained  under  a given  set  of  conditions. 

(3)  Average  slant  range  of  detection  Is  the  mean  of  the  average  detection 
ranges  for  all  angles  of  elevation  and  azimuth  of  the  aircraft  from 
the  submarine. 

(4)  MAD  sweep  width  Is  a function  of  two  primary  factors,  namely,  the 
average  detection  range  of  the  MAD  Installation  and  the  vertical 
separation  between  the  submarine  and  aircraft. 

REFERENCE:  Final  Report  on  Project  OP/VT 26/J1 5-6 

"Evaluation  of  the  AN/ASQ-8  Magnetic  Airborne  Detection  Set" 

16  June  1955,  UNCL. 
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EDC11  - Electronic  Warfare  System 


DESCRIPTION:  This  Is  a shipboard  system  which  performs  the  functions  of 
electromagnetic  signal  Intercept,  analysis,  Identification,  display,  ECM, 
and  ship  command  and  control  system  Interfacing. 

(1)  SPECIFIC  OBJECTIVE:  Determine  surveillance  capability  against  airborne 
radars  for  given  receiver/antenna  combination. 

MOE  ■ average  maximum  Intercept  range  as  a function  of  relative 
bearing 

(2)  SPECIFIC  OBJECTIVE:  Determine  range  performance  In  ECM  modes. 

(MOE ) i ■ Mean  DECM  (defensive  electronic  countermeasures) 
burnthrough  range 

(MOE) 2 ■ Mean  noise  jamming  burnthrough  range 

(3)  SPECIFIC  OBJECTIVE:  Determine  reaction  time  capability  In  ECM  modes. 


(MOE)^  ■ Mean  DECM  reaction  time  for  given  mode  of 
operation 

(M0E)2  * Mean  noise  janmlng  reaction  time 
ASSUMPTIONS: 

(1)  DECM  modes  of  operation  are  either  automatic  or  machine-assist. 

(2)  DECM  reaction  time  Is  defined  as  the  elapsed  time  from  detection 
of  the  threat  emitter  to  radiation  against  the  threat  emitter. 
Detection  time  was  taken  to  be  the  time  when  emitter  activity 
was  reported  to  the  computer  by  the  Activity  Indicator  Module 
(AIM). 

(4)  SPECIFIC  OBJECTIVE:  Evaluate  the  capability  of  the  system  to  analyze 
and  identify  signals. 


(MOE), 


Percent  correctly  Identified  EMCON  violators 

/Number  of  EMCON  v1olators\ 

'correctly  Identified  / 

/Number  of  Unique  friendly) 

'identifications  ' 


x 100 


(MOE)-  ■ Percent  correctly  Identified  EMCON  non-violators 


/Number  of  EMCON  non-viol ators\ 
'correctly  Identified  / 

/dumber  of  Unique  FH end ly\ 
'identifications  / 


x 100 


(HOE)3 


(M0E)4 


Percent  signals  Identified  that  were  unique 
Identifications 


/Number  of  unique  s 
'Identifications 


Ignal^ 


/Number  of  signals 
'Identified 


x 100 


Percent  signals  identified  that  were  ambiguous 
identifications 


Number  of  ambiguous  signal  identifications 
Number  of  signals  Identlfl ed 


x 100 


(moe)5 


(moe)6 


Percent  emitters  Identified  that  were  unique 
identifications 


/Number  of  unique  emitter 

'Identifications . 

/Number  of  emitters! 
'Identified  / 


xlOO 


Percent  emitters  identified  that  were  ambiguous 
Identifications 


/Number  of  ambiguous  emitter’ 

'Identifications ; 

/dumber  of  emitters! 
'Identified  ' 


x 100 


(M0E)7 

(MOE)g 

(M0E)g 


(M0E)10 


Percent  of  time  PRF  (pulse  repetition  frequency) 

was  present  In  unique  Identifications 

Number  of  times  PRF  was  present  100 
Number  ot  unique  Identifications 

Percent  of  time  PW  (pulse  width)  was  present 

In  unique  identifications 

Number  of  times  PW  was  present  1nn 
Number  of  unique  identifications  x uu 

Percent  of  time  frequency  was  present  in 

unique  Identifications 

/Number  of  times  frequency' 

'was  present  / inn 

Number  of  unique  Identifications  uu 

Percent  of  time  scan  Information  was  present 

In  unique  Identifications 


/Number  of  times  scan  Information 
■ pres*nt 

Number  of  unique  Identifications 


x 100 
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ASSUMPTIONS: 

(1)  Unique  Identifications  Include  Unique  Hostile  and  Unique  Friendly. 

(2)  Ambiguous  Identifications  Include  Ambiguous,  Multiple  Friendly, 
and  Multiple  Hostile,  all  of  which  require  operator  resolution 
of  the  amblqulty. 

(3)  Unknown  Identifications  are  generic  Identifications  for  which  there 
Is  no  specific  match  In  the  emitter  library. 

REFERENCE:  Final  Report  on  Project  0/S163 

"Conduct  an  Operational  Evaluation  of  the  AN/SLQ-27  (XN-1) 
SHORTSTOP  System" 

12  July  1972,  SECRET 
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EDC12  - ECM  Receiving  Antenna 

DESCRIPTION:  This  Is  an  antenna  assembly  which  Is  designed  to  permit 
detection,  accurate  direction  finding,  and  signal  analysis  when  used 
with  passive  ECM  receivers. 

(1)  SPECIFIC  OBJECTIVE:  Determine  direction  finding  accuracy. 

(MOE)^  ■ Mean  direction  finding  (DF)  error  (deg) 

(MOEjg  ■ Direction  finding  error  probtbll  Ity,  which 
Is  defined  as  the  probability  of  DF  error 
within  - la  of  the  mean  DF  error. 

ASSUMPTION:  A normal  distribution  of  DF  error  is  assumed  for 
computation  of  (MOE^. 

(2)  SPECIFIC  OBJECTIVE:  Determine  signal  detection  range  capability. 

(MOE)'|  * Mean  detection  range 
(M0E)2  ■ Median  detection  range 

REFERENCE:  Final  Report  on  Project  C/S2  FY60 

"Concurrent  Evaluation  of  the  Antenna  AS-899/SLR" 

7 Nov.  1960,  CONF. 
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EDC13  - Shipboard  Direction  Finding  System 

DESCRIPTION:  This  system  Is  designed  to  provide  radio  frequency  (RF) 
spectrum  surveillance,  Intercept  and  direction  finding  to  surface  and 
land-based  threat  emitters. 

(1)  SPECIFIC  OBJECTIVE:  Determine  ability  to  obtain  bearing  angles  of 
. target  emitters. 

MOE  ■ Mean  absolute  bearing  error  (deg),  which  Is  defined  as 
the  average  absolute  difference  between  the  system  esti- 
mated bearing  angle  and  an  applicable  reference  bearing 
angle  (such  as  fire  control  radar,  visual  or  plotted) 

REFERENCE:  Final  Report  on  Project  0/S200 

"Conduct  an  Operational  Evaluation  of  the  AN/SRD-19  (XN-1 ) 
Direction  Finding  System" 

1974,  CONF. 
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EDC14  - Radio  Direction  Finder 

DESCRIPTION:  This  equipment  Is  designed  to  aid  nuclear  submarines  In  per- 
forming direction  finding  on  enemy  radio  signals,  surveillance  and  threat 
assessment. 

(1)  SPECIFIC  OBJECTIVE:  Determine  signal  Intercept  capability. 

HOE  « Number  of  tactically  significant  signals  Intercepted  per 
hour  of  antenna  exposure 

REFERENCE:  Final  Report  on  Project  0/S150 

"Conduct  an  Operational  Evaluation  of  the  AN/BRD-7" 

26  June  1970,  SECRET 
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EDC15  - Radio  Frequency  Oscillator  (RFO) 


DESCRIPTION:  The  RFO  Is  designed  to  provide  an  additional  protection  for 
ships  by  denying  accurate  range  Information  required  for  radar  directed 
bombing  and  missile  attacks.  This  Is  a subsystem  to  a radar  blip  enhancer 
and  deception  repeater  countermeasures  system  used  against  pulsed  radar*. 

(1)  SPECIFIC  OBJECTIVE:  Determine  the  effective  ranges  and  trackbreak 
capability  of  the  countermeasures  system  against  attacking  track 
radar  systems. 

(M0E)1  ■ Average  maximum  lock-on  range  for  given  trackbreak 
mode 

(M0E)2  ■ Average  maximum  trackbreak  range  for  given  track- 
break  mode 

(M0E)3  ■ Average  crossover  range  (i.e.,  minimum  effective 
range)  for  given  trackbreak  mode 

(MOE)^  ■ Average  number  of  trackbreaks  per  radar  run  for 
given  trackbreak  mode 

■ Number  of  trackbreaks 
Number  of  radar  runs 


REFERENCE:  Final  Report  on  Project  C/S43 

"Conduct  a Concurrent  Evaluation  of  the  Radio  Frequency 
Oscillator  0-1331  (XN-1 J/ULQ-S” 

28  Nov.  1966,  SECRET 
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EDC16  - Deception  Repeater 

DESCRIPTION:  This  countermeasures  set  Is  a device  having  potential  electronic 
warfare  application  against  enemy  search  and  tracking  radars.  It  Is  Intended 
to  present  either  a false  radar  target  or  cause  the  enemy  radar  to  "break- 
track"  or  do  both.  Using  It  as  a target  decoy  device,  a small  ship  can 
present  a blip  comparable  to  that  of  a capital  ship  on  the  scope  of  an 
enemy  radar.  Using  It  as  a track-break  (jammer)  device  to  Introduce  false 
scan  modulation,  a ship  can  divert  the  beam  of  an  enemy's  conical  scan 
missile  control  or  tracking  radar  and  thereby  disrupt  his  weapon  control 
solution. 

(1)  SPECIFIC  OBJECTIVE:  Determine  effective  range  capability  In  various 
modes  of  operation. 

(MOE)^  ■ Average  triggering  range  of  deception 
repeater  by  airborne  radar 

(M0E>2  * Average  maximum  effective  range  In  target 
decoy  mode 

(M0E)3  * Average  minimum  effective  range  In  target 
decoy  mode 

(MOE)^  ■ Average  maximum  effective  range  In  track-  * 

break  mode 

(MOE)g  ■ Average  minimum  effective  range  In  track- 
break  mode 

(2)  SPECIFIC  OBJECTIVE:  Determine  authenticity  cf  enhanced  radar  echoes. 

HOE  ■ Probability  of  discrimination  between  decoy 

and  true  target  as  a function  of  range 

/Number  of  times  discrimination  occurredN 
(between  decoy  and  true  target  within  a 1 

, \o1ven  range  band  / 

/Number  of  decoy  and  target  opportunities'! 

Vwlthln  a given  range  band  / 
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(3)  SPECIFIC  OBJECTIVE:  Determine  the  capability  of  performing  radar 
deception. 

HOE  ■ Probability  of  successful  deception  for  given 

mode  of  operation 

m Number  of  successful  deceptions 
Number  of  deception  attempts  " 

(4)  SPECIFIC  OBJECTIVE:  Dftermiine  the  capability  to  blank  signals  from 
friendly  radars. 

MOE  ■ Probability  of  successful  blanking 

, Number  of  times  radar  signals  were  blanked 
Number  of  blanking  opportunities 

REFERENCES:  (1)  Final  Report  on  Project  C/S70 

"Evaluate  the  AN/SLQ-17(V)  Countermeasures  Set" 

29  July  1971,  SECRET 
(2)  Final  Report  on  Project  6/S10  FY61 

"Concurrent  Evaluation  of  Deception  Repeaters" 

10  March  1961,  CONF. 
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EDC17  - Aircraft  Radar/Mlsslle  Homing  and  Warning  Receiver 

DESCRIPTION:  This  system  provides  aural  and  visual  Indications  of  the 
presence  and  bearing  of  threat  associated  radars,  as  well  as  aural  and 
visual  warnings  of  surface-to-air  missile  threats. 

(1)  SPECIFIC  OBJECTIVE:  Provide  correct  warning  Indications  when  operated 
In  a multiple  threat  environment  against  both  surface-to-air  and 
air-to-air  radars. 

HOE  ■ Probability  of  correct  warning  Indication 

m Number  of  correct  Indications 
Number  of  signals  actually  emitted 

(2)  SPECIFIC  OBJECTIVE:  Provide  missile  warning  during  the  Ingress,  attack 
and  egress  segments  of  representative  strike  missions. 

MOE  ■ Percentage  of  time  missile  warning  was  provided 

m Total  time  warning  observed 
Total  test  Hme 

REFERENCE:  Twenty-sixth  Partial  Report  on  Project  F/0210 

"Evaluation  of  the  Charger  Blue  Equipment  Installed  In  F-4 
Aircraft" 

9 April  1973,  SECRET 
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EDC18  - Radio  Frequency  Amplifier 


DESCRIPTION:  This  unit  Is  designed  to  Increase  the  power  output  of  a 
countermeasures  set  which  functions  as  a radar  decoy  (blip  enhancer) 
and  deception  repeater  against  pulsed  radars. 

(1)  SPECIFIC  OBJECTIVE:  Determine  ability  of  the  system  (countermeasures 
set)  to  counter  tracking  radars  for  each  mode  of  operation. 

(MOE)^  ■ Average  time  to  lock-on 

(H0E)2  * Average  time  to  breaklock 

(MOE)^  * Burnthrough  range,  which  Is  defined  as  the  range 
at  which  the  reflected  energy  Is  theoretically 
just  equal  to  the  countermeasures  set  signal 

(MOE)^  ■ Average  number  of  breaks  per  run 

(MOE)g  ■ Average  crossover  range,  which  Is  defined  as  the 
minimum  effective  range 


ASSUMPTION:  Burnthrough  range  Is  estimated  as  the  range  where  the  last 
lock-on  occurred. 


REFERENCE:  Final  Report  on  Project  C/S52 

"Conduct  a Concurrent  Evaluation  of  Amplifier  R.F.,  AM-4530/ 
ULQ-6A" 

1 May  1968,  SECRET 
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EDC19  - Decoy  Repeater  Buoy 

DESCRIPTION:  This  Is  a buoy  mounted  version  of  a countermeasures  set 
whose  purpose  1$  to  create  aircraft  carrier  size  radar  returns  to 
deceive  surface  search  radars. 

(1)  SPECIFIC  OBJECTIVE:  Evaluate  deception  capability. 

(MOE)j  * Average  maximum  range  at  which  an  airborne  radar 
could  receive  Its  own  signal  returned  by  the  buoy 
for  given  aircraft  altitude 

(M0E)2  ■ Average  minimum  range  at  which  the  radar  operators 
were  not  able  to  discriminate  between  a large  ship 
target  and  the  buoy 

REFERENCE:  Final  Report  On  Project  F/0  145  FY63 

"Fleet  Operational  Evaluation  of  Decoy  Repeater  Buoy,  AN/ULQ-5" 
10  July  1963,  CONF. 
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EDC20  - Noise  Jammer 

DESCRIPTION:  This  equipment  Is  utilized  on  strike  aircraft  and  Is  designed 
to  jam  both  the  elevation  and  azimuth  tracking  channels  of  a surface-to-air 
missile  tracking  radar. 

(1)  SPECIFIC  OBJECTIVE:  Evaluate  the  capability  of  the  noise  jammer  to 
provide  protection  for  a strike  aircraft. 

MOE  ■ Percentage  of  missile  miss  distances  within  a given 
range  (the  lethal  radius)  of  the  aircraft 
» f{tv  X2,  X3) 

where 

X^  ■ jarr-to-slgnal  ratio  as  a function  of  distance  from 
the  radar 

X2  * tracking  error  In  elevation  as  a function  of  jam- 
to-slgnal  ratio 

X3  ■ tracking  error  In  azimuth  as  a function  of  jam-to- 
slgnal  ratio 


ASSUMPTION:  Effectiveness  Is  defined  as  follows: 


(a)  Good  - A MOE  value  of  20 X or  less 

(b)  Fair  - A MOE  value  between  20*  to  40* 

(c)  Poor  - A MOE  value  greater  than  40* 


DATA  REQUIREMENTS  SUMMARY: 


DATA  ITEM 


xr  X 

f(X 


2’ 

, X. 


*3 
. X, 


ATTACK  LABORATORY 

EXERCISE  SIMULATION 

X 

X 


REFERENCE:  Twentieth  Partial  Report  on  Project  F/0210 

"Develop  Aircraft  Tactics  Against  Surface-to-AIr  Weapons  Sites, 
Evaluation  of  the  ALT-27  In  the  EKA-3B  Aircraft" 

31  May  1972,  SECRET 


TABLE  8-2  Operational  Test  & Evaluation 
MOE  Data  Base  (Continued) 


Area:  Fire  Control  (FC) 


CODE 

ITEM 

FC1 

Aircraft  Navigation/Weapon  Delivery 
System 

FC2 

Shipboard  Gun  Fire  Control  System 
(Mk  87,  Mk  86  Mod  0) 

FC3 

Underwater  Fire  Control  System  (Mk  114) 

FC4 

Missile  Fire  Control  System 

FC4-1 

Shipboard  Missile  Fire  Control  Radar 
(AN/SPQ-51B) 

FC4-2 

Airborne  Missile  Fire  Control  Radar 
(F-4  AMCS  Aero  1A,  F-8  AWG-4) 

FC4-3 

Shipboard  Missile  Fire  Control  System 
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FIRE  CONTROL  (FC) 


FC1  - Aircraft  Navloatlon/Weapon  Delivery  System 

DESCRIPTION:  This  Is  an  aircraft  bombing  system  capable  of  delivering 
sticks  of  bombs. 


(1)  SPECIFIC  OBJECTIVE:  Determine  closest  bomb  and  stick  centroid  miss 
distances  for  given  stick  size  and  release  Interval. 

(MOE)^  ■ Range  error  probable  (REP),  which  Is  defined  as 
the  median  of  the  absolute  values  of  the  range 
error  measured  from  a reference  point  (namely, 
the  Intended  target) 

(M0E>2  “ Deflection  error  probable  (DEP),  which  Is  defined 
as  the  median  of  the  absolute  values  of  the 
deflection  error  measured  from  a reference  point 
(namely,  the  Intended  target) 

(MOEJj  * Circular  error  probable  (CEP),  which  Is  defined 
as  the  median  miss  distance  from  the  target 

HIGHER  LEVEL  EVALUATION: 


MOE  ■ Probability  of  target  kill  for  given  stick  size  and 
release  Interval 


f1  (MAE,  Xr.. 
f2  (EMO,  X^.. 
f3  (BEI,  Xr.. 


.X5) 

.*> 

.x5) 


for  soft  targets 
for  hard  targets 
for  bridge  targets 


where 


MAE  ■ mean  area  of  effectiveness,  which  depends  on 
target  type,  bomb  type,  damage  (or  kill) 
criterion  and  bomb  Impact  angle 
EMD  * effective  miss  distance,  which  depends  on 
target  type,  bomb  type  and  damage  (or  kill) 
criterion 

BEI  ■ bridge  effectiveness  Index,  which  depends  on 
bridge  type,  bomb  type  and  fuzing  type 
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X^  ■ number  of  bombs  per  stick 
%2  ■ ratio  of  the  minor  axis  length  of  the  elliptical 
fragmentation  pattern  per  bomb  to  the  major  axis 
length  of  the  elliptical  fragmentation  pattern 
per  bomb 

Xj  ■ stick  length 

X^  ■ stick  width 

Xg  ■ CEP  of  stick  centroid  ( 1 . e . . (M0E)3) 

(NOTE:  The  Indices  MAE,  EMD  and  BEI  are  given  In  the  Joint 

Munitions  Effectiveness  Manual  (JMEM)  and  the  formulas  for 
the  MOE,  as  determined  by  the  functions  f^ , f2  and  f3,  are 
given  by  target  type  In  the  JMEM.) 

LONER  LEVEL  EVALUATION: 


For  the  case  of  stick  centroid  accuracy, 


(MOE ) 1 


stick  centroid  total  range  error 


/REP  due  to 
\ system/ aiming  error 


+ 


/REP  due  to  stick 
( centroid  ballistic 
\dlsperslon 


2 1 1/2 


/REP  due  to 
\ system/aiming  error 


/REP  due  to  Individual 
( bomb  ballistic 

\dlsperslon 

/Number  of  bombs  1n\ 
'stick  / 


2 1/2 
*1 


(MOE) 2 


stick  centroid  total  deflection  error 


DEP  due  to 
system/aiming  error 


/DEP  due  to  stick 
( centroid  ballistic 
\dlsperslon 


1/2 


/DEP  due  to 
\ system/aiming  error 


+ 


/DEP  due  to  Individual 
1 bomb  ballistic  dls- 
Voerslon 


2 1/2 


/Number  of  bombs  In 
' stick 
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(MOE )3  ■ stick  centroid  total  circular  error 


CEP  due  to 
systen:/a Imlng  error 


+ 


/ CEP  due  to  stick 
( centroid  ballistic 
\dlsperslon 


2 


/CEP  due  to 
\ system/aiming  error 


/CEP  due  to  Individual 
( bomb  ballistic  dls- 

+ \pers1on 

/Number  of  bombs  in\ 
Vstlck  / 


ASSUMPTIONS: 


(1)  Stick  centroid  Is  defined  as  the  mean  point  of  Impact 
of  the  bombs  In  the  stick. 

(2)  Closest  bomb  In  the  stick  Is  defined  as  that  bomb 
Impact  In  the  stick  having  the  shortest  radial  miss 
distance  from  the  target. 

(3)  For  the  higher  level  evaluation,  bomb  range  and  deflec- 
tion errors  are  assumed  to  be  each  approximately  normally 
distributed. 

(4)  For  the  lower  level  evaluation,  the  formulations  are  valid 
for  a salvo  (Instantaneous)  release  from  the  centerline  of 
the  aircraft. 


REFERENCE:  Final  Report  on  Project  0/V28E08 

"A-7E  Computer  Accuracy  (MRI  Evaluation)" 
6 June  1973,  CONF. 


1/2 

2 1/2 
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FC2  - Shipboard  Gun  Fire  Control  System 

DESCRIPTION:  This  Is  an  Integrated  lightweight  system  which  Includes  the 
capabilities  of  continuous  air  and  surface  radar  search,  rapid  acquisition 
of  targets,  simultaneous  track  on  more  than  one  target,  and  solutions  for 
gun  orders  to  simultaneously  engage  separate  targets. 

(1)  SPECIFIC  OBJECTIVE:  Determine  surface  target  detection  and  tracking 
capability. 

(MO£)j  * Mean  minimum  discernible  range  of  a small  surface 
target  as  a function  of  pulse  width 

(MOE * Mean  maximum  detection  range  of  a destroyer  as  a 
function  of  aspect 

(MOE)^  * Mean  maximum  tracking  range  of  a destroyer  as  a 
function  of  aspect 

(M0E)4  ■ Mean  range  resolution  of  two  targets  while  In  the 
SEARCH  mode 

(MOE)g  ■ Mean  bearing  resolution  of  two  targets  while  In  the 
SEARCH  mode 

(MOE)g  ■ Percentage  of  runs  on  which  track  was  maintained  on 
a target  In  proximity  to  another  target  while  In  the 
TRACK  WHILE  SCAN  mode  as  a function  of  shlpr-to-target 
range  and  target  speed 

(2)  SPECIFIC  OBJECTIVE:  Determine  system  capability  to  control  gunfire  against 
airborne  targets. 

(MOE)^  ■ Initial  salvo  error  In  range  for  given  target 
range  band 

(MOE)^  * Initial  salvo  error  in  deflection  for  given 
target  range  band 

(3)  SPECIFIC  OBJECTIVE:  Determine  system  capability  to  control  gunfire 
In  shore  bombardment. 
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( MO E ) i ■ Percent  target  hits 

_ Number  of  direct  hits  „ ,nn 
Number  of  rounds  fired  * '00 

(MOE)^  ■ Mean  Impact  error  In  range  for  given  target  range 
band 

(MOE)^  * Mean  Impact  error  In  deflection  for  given  target 
range  band 

(MOE)^  ■ Initial  salvo  error  In  range  for  given  target  range 
band 

(MOE)g  ■ Initial  salvo  error  In  deflection  for  given  target 
range  band 

(4)  SPECIFIC  OBJECTIVE:  Determine  the  capability  of  the  system  to  track 
surface  radar  targets  In  an  ECM  environment. 

NOE  ■ Probability  of  not  breaking  track  in  the  presence  of 
jamming 

• i . Number  of  times  jammlrwa  causes  trackbreak 
“ Number  of  valid  runs 

REFERENCES;  {1)  Final  Report  on  Project  C/S48 

"Conduct  a Concurrent  Evaluation  of  the  Gun  Fire  Control 
System  Mk  87" 

8 April  1970,  CONF. 

(2)  Supplement  to  Final  Report  on  Project  C/S45 

"Conduct  a Concurrent  Evaluation  of  the  Gun  Fire  Control 
System  Mk  86  Mod  0" 

4 April  1967,  SECRET 
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FC3  - Underwater  Fire  Control  System 

DESCRIPTION:  The  system  Is  an  antisubmarine  computing  system,  providing 
for  fire  control  computations,  weapon  control  outputs,  and  launcher  orders. 
While  primarily  designed  to  control  ASROC  firing,  the  system  also  provides 
fire  control  data  for  the  control  of  over-the-slde  launched  torpedo  attacks, 
both  fixed  and  trainable  hedgehog  projectors,  and  provides  an  almpolnt 
display  suitable  for  use  as  an  aid  In  controlling  DASH  attacks. 

0)  SPECIFIC  OBJECTIVE:  Determine  the  accuracy  of  the  system's  fire  control 
solution. 

(MOE)^  ■ Mean  target  course  error  (deg)  based  on 
sonar  Input  for  given  target  range  band 
and  speed  Interval 

(MOE ) g * Mean  target  course  error (deg)  based  on 
radar  Input  for  given  target  range  band 
and  speed  Interval 

(MOE) 3 ■ Mean  target  speed  error  (kts)  based  on 
sonar  input  for  given  target  range  band 
and  speed  Interval 

(M0E)4  ■ Mean  target  speed  error  (kts)  based  on 
radar  Input  for  given  target  range  band 
and  speed  Interval 

(MOE)g  ■ Mean  computer  error  (yds),  which  Is  defined 
as  the  distance  between  the  location  of  the 
computer's  almpolnt  at  time  of  fire  and  an 
almpolnt  graphically  reconstructed  using 
the  same  target  information  available  to 
the  computer  at  time  of  fire 

(MOE)g  ■ Mean  sonar  location  error  In  range  (yds) 

(MOE)^  * Mean  sonar  location  error  In  bearing  (deg) 
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(2)  SPECIFIC  OBJECTIVE:  Determine  the  accuracy  of  the  system's  fire  control 
solution  as  an  aid  In  controlling  DASH. 

(MOE)1  ■ Mean  delivery  error  (yds),  based  on  a 
comparison  of  the  computed  range  and 
bearing  to  the  almpolnt,  and  the  actual 
radar  range  and  bearing  to  the  helicopter 
at  the  launch  point 

(MOE >2  * Mean  computer  error  (yds),  which  Is  defined 
as  the  distance  between  the  location  of 
the  computer's  almpolnt  at  time  of  weapon 
drop  and  an  almpolnt  reconstructed  graphi- 
cally using  the  same  target  Information 
available  to  the  computer  at  time  of  fire. 

(MOE) 3 ■ Mean  target  course  error  (deg)  based  on 
attack  console  computation 
(MOE)4  ■ Mean  target  speed  error  (kts)  based  on 
attack  console  computation 

(3)  SPECIFIC  OBJECTIVE:  Determine  the  accuracy  of  the  system's  fire  control 
solution  for  over-the-slde  launched  torpedo  attacks. 

(MOE)^  ■ Mean  torpedo  launch  error  (yds),  which  Is 
defined  as  the  distance  between  the  com- 
puted torpedo  almpolnt  as  generated  by 
the  attack  console  and  the  almpolnt  at 
which  the  torpedo  was  actually  fired 
(MOE)2  * Mean  computer  error  (yds) 

(M0E)3  ■ Mean  computed  target  course  error  (deg) 

(MOE)^  » Mean  computed  target  speed  error  (kts) 

REFERENCE:  Final  Report  on  Project  C/S24  FY62 

"Concurrent  Evaluation  of  the  Fire  Control  System  Mk  114" 

3 Dec.  1962,  CONF. 
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FC4  - Missile  Fire  Control  System 
FC4-1  Shipboard  missile  fire  control  radar 

DESCRIPTION:  This  shipboard  missile  fire  control  radar  Is  designed  to 
track  and  Illuminate  both  airborne  and  surface  targets. 

(1)  SPECIFIC  OBJECTIVE:  Determine  target  acquisition  and  tracking  capability. 

(MOE)^  ■ Mean  time  to  Initial  acquisition  for  given 
target  altitude 

(M0E)2  * Mean  target  In'tMl  acquisition  range  for 
given  target  altitude 

(M0E)3  * Acquisition  rate  ( X ) 

. Number  of  targets  successfully  acquired  , 

Number  of  valid  acquisition  opportunities  x uu 

ASSUMPTIONS: 

(1)  Acquisition  time  Is  assumed  to  mean  the  elapsed  time 
between  designation  of  the  radar  to  a designation 
channel  and  the  subsequent  reliable  acquisition 
(track)  of  the  target  by  the  radar. 

(2)  An  acquisition  was  normally  considered  reliable  If 
an  "on-target"  Indication  was  not  followed  within 
five  seconds  by  a "not  on-target"  signal. 

(3)  Acquisition  range  Is  assumed  to  be  the  range  of  the 
target  at  the  time  of  reliable  acquisition. 

REFERENCE:  Final  Report  on  Project  C/S47 

"Conduct  a Concurrent  Evaluation  of  the  AN/SP6-51B  Radar 
Improved  Data  Converter" 

30  Aug.  1968,  SECRET 

FC4-2  Airborne  missile  fire  control  radar 

DESCRIPTION:  This  fire  control  radar  Is  part  of  an  airborne  missile  control 
system  (AMCS)  with  the  capability  of  performing  radar  search,  target  acquis- 
ition and  target  track. 
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(1)  SPECIFIC  OBJECTIVE:  Determine  system  acquisition  and  tracking  capability 
against  airborne  targets  employing  countermeasures. 


(NOE)^  ■ Probability  of  successful  track  of  target  In 

the  chaff  only  environment 

/Number  of  successfully  tracked  targets' 
m 'In  chaff  only  environment  ' 

* /Number  of  Intercept  attempts  In  the  chaff \ 

'only  environment  ' 

(MOEjg  ■ Probability  of  lock  transfer  to  chaff  In  the  chaff 

only  environment 

/Number  of  times  lock  transfer  to  chaff  occurred' 

. 'in  the  chaff  only  environment  / 

/Number  of  Intercept  attempts  In  the  chaW\ 

'only  environment  ' 

(MOE)^  * Probability  of  successful  Intercept  In  the  noise 

jamming  only  environment 

/Number  of  successful  target  Intercepts  1n\ 
a 'the  noise  jamming  only  environment 

/Number  of  Intercept  attempts  \ 

'In  the  noise  jamming  only  environment/ 

(MOE)^  « Probability  of  noise  jammer  programming  preventing 

target  acquisition 

/Number  of  times  noise  jammer  programming  pre-) 

m 'vented  target  acquisition 

/Number  of  intercept  attempts  In  the  noise\ 

'jamming  only  environment  > 

(MOE)g  ■ Probability  of  successful  track  of  target  employing 

spot  or  spot  sequential  noise 

/Number  of  successfully  tracked  targets  \ 

. ' employing  soot  or  spot  sequential  noise/ 

/Number  or  Intercept  attempts  In  the  spot' 

'or  spot  sequential  noise  environment  / 


(HOE)g  ■ Probability  of  successfully  completed  Inter- 
cept In  the  deception  only  environment 

/Number  of  successfully  completed  Intercepts 

M 'In  the  deception  only  environment  , 

/Number  of  Intercept  attempts  in  the\ 
'deception  only  environment  ' 
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(MOE)^  ■ Probabil  ity  of  successfully  completed  Intercept 

In  the  evading  target  environment 

/Number  of  successfully  completed  1ntercepts\ 

m Mn  the  evading  target  environment / 

/Number  of  Intercept  attempts  In  the\ 
vevadlng  target  environment  / 

(MOE)g  ■ Probability  of  successful  Intercept  In  the  noise 

jamming,  chaff  and  evading  target  environment 

/Number  of  successful  Intercepts  In  the  noise  \ 

, \ lamming,  chaff  and  evading  target  environment/ 
/Number  of  intercept  attempts  In  the  noise  ” 

\ jamming,  chaff  and  evading  target  environment/ 

(M0E)9  ■ Probability  of  successful  Intercept  In  the  chaff 

and  deception  environment 

/Number  of  successful  Intercepts  In  the  chaff \ 

m Und  deception  environment / 

* /Number  of  Intercept  attempts  ^n  the  chaff \ 

Vand  deception  environment  / 

(M0E)10«  Probability  of  successful  Intercept  In  the  chaff, 

noise,  deception  and  evading  target  environment 

/Number  of  successful  Intercepts  In  the  chaff,  \ 
„ 'noise,  deception  and  evading  target  environment/ 
/Number  of  Intercept  attempts  In  the  chaff,  T 
vnolse,  deception  and  evading  target  environment/ 

(MOE)-jj*  Probability  of  successful  reattack 

« Number  0f  successful  reattacks 
“ Number  of  reattack  attempts 

(MOE ) i 2*  Probability  that  target  countermeasures  are 

effective  In  preventing  radar  or  IR  tracks  In 

reattack  attempts 

(Number  of  times  target  countermeasures  are 
effective  in  preventing  radar  or  IR  tracks 

a In  reattack  attempts 

* /Number  of  reattack  attempts  In  the  presence 
\of  target  countermeasures 
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(HOE) 


13 


(MOE) 


14 


(MOE) 


15 


(MOE) 


16 


Probability  that  target  evasive  maneuvers  are 
effective  In  preventing  successful  reattack 
attempts 

(Number  of  times  target  evasive  maneuversN 
are  effective  In  preventing  successful  1 

reattack  attempts ^ (_ 

/Number  reattack  attempts  In  the  \ 

'presence  of  target  evasive  maneuvers/ 

Probability  that  target  countermeasures  and 

evasive  maneuvers  are  effective  In  preventing 

successful  reattack  attempts 

/Number  of  times  target  countermeasures  \ 

( and  evasive  maneuvers  are  effective  In  ] 

\ preventing  successful  reattack  attempts/ 

(Number  of  reattack  attempts In  the 
presence  of  target  countermeasures  and] 
evasive  maneuvers 

Probability  of  successful  Intercept  In  the 

communications  countermeasures  only  environment 

/Number  of  successful  Intercepts  In  the> 

( communications  countermeasures  only 
\ environment 

/Number  ol^  Intercept  attempts  In  the\ 
communications  countermeasures  only  1 
environment  / 

Probability  of  successful  Intercept  In  the 

combined  communications  and  weapon  system 

countermeasures  environment 

(Number  of  successful  intercepts  in  the  com- 
bined communications  and  weapon  system 

countermeasures  environment , 

/dumber  of  Intercept  attempts  in  the  comblnedX 
(communications  and  weapon  system  counter-  1 
\measures  environment  / 


* 

t\ 

vir 

•) 


•) 


ASSUMPTIONS; 


(1)  3y  "deception"  Is  meant  angle  or  range  gate  deception. 

(2)  Intercepts  were  scored  successful  if  the  fighter 
reached  final  position  within  the  missile  launch 
envelope,  and  the  weapon  system  tracked  the  target, 
Irrespective  of  tracking  mode  except  boreslght,  for 
a specified  period  prior  to  simulated  missile  launch 
and  throughout  the  predicted  time  of  missile  flight. 
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(3)  Reattacks  wart  scortd  successful  only  If  completed 
on  rider  or  Air  Intercept  Controller  (AIC)  Infor- 
iim t. inn  .md  r,i'l/ir  r.r.ick  could  be  maintained  for  a 
missile  launch. 

(4)  Communications  countermeasures  are  effective  If  the 
Intelligible  reception  of  the  required  transmissions 
Is  prevented. 

REFERENCE:  First  Partial  Report  on  F/0198 

"F-4  AMCS  Aero  1A  and  F-8  AWG-4  in  Single  and  Combined 
Countermeasures  Environments" 

27  Oct.  1966,  SECRET 

FC4-3  Shipboard  missile  fire  control  system 

DESCRIPTION:  This  Is  a shipboard  guided  missile  fire  control  system  (GMFCS) 

which  fires  a surface-to-air  or  surface-to-surface  missile. 


(1)  SPECIFIC  OBJECTIVE:  Evaluate  ability  to  engage  surface  launched  cruise 

missile  (SLCM)  raids. 


(MOE ) 1 
(M0E)2 


Percent  targets  engaged 

Number  of  targets  enqaqed  ..  ,rtrt 
Number  of  missile  targets  x '00 

Percent  of  attacks  In  which  all  targets  were 

engaged 


/Number  of  attacks  in  which  all 

\ targets  were  engaged 

Number  of  missile  raids 


x 100 


(M0E)3  ■ Average  total  engagement  time 
(MOE)^  ■ Minimum  total  engagement  time 
(M0E)5  ■ Maximum  total  engagement  time 

ASSUMPTION:  Total  engagement  time  is  the  time  from  launch  of  the 


first  SLCM  to  fire  of  a shipboard  missile  at  the  last  SLCM  In 


the  raid. 


(2)  SPECIFIC  OBJECTIVE:  Evaluate  the  ability  of  the  system  to  acquire 

surface  launched  cruise  missile  targets  for  selected  acquisition  methods. 


B-96 


FC4 


(HOE ■ Average  acquisition  time 

(M0E>2  ■ Acquisition  reliability 

m Number  of  missiles  acquired 
* Number  of  missile  targets 

(HOE ) ^ ■ Cumulative  percent  acqulsltons  as  a function 

of  time 

(MOE)^  ■ Cumulative  percent  acquisitions  for  given 
range  band 


(3)  SPECIFIC  OBJECTIVE:  Evaluate  the  iLilllty  of  the  system  to  launch 
missiles  against  surface  launched  cruise  missile  targets. 


(HOE), 

(NOE). 


(NOE). 


(HOE ) . 


* Average  time  from  acquisition  to  Initial  fire 

■ Cumulative  percent  of  firings  as  a function  of 
time  from  acquisition  to  Initial  fire 

■ Firing  success  rate  (X) 

_ Number  of  Intercepts  w 
Number  of  missiles  fired  x 

■ Firing  success  rate  (X)  given  an  opportunity 
to  engage  the  target 

. Number  of  Intercepts^  „ 

/Number  of  missiles  f1red\ 

/ at  targets  for  which  an 
l opportunity  for  engage- 
\ment  existed 


(M0E)5  ■ Average  reaction  time  from  SLCH  launch  to  ship- 
board missile  firing 
(MOE)g  « Median  reaction  time 
(M0E)7  « Average  refire  time 

ASSUMPTION:  Refire  time  Is  the  time  from  fire  of  a missile  with 
one  missile  fire  control  system  at  the  target  to  fire  again  with  a 
different  missile  fire  control  system. 


(4)  SPECIFIC  OBJECTIVE:  Evaluate  the  ability  of  the  system  to  acquire 
surface  targets. 

(NOE),  " Mean  detection  range 
(H0E>2  ■ Mean  time  to  acquire  the  surface  target 
(MOE)j  " Cumulative  percent  acquisitions  as  a function  of 
time 
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(5)  SPECIFIC  OBJECTIVE:  Evaluate  tracking  capability. 

(MOE)^  ■ Average  Initial  acquisition  range,  which  Is  defined 
as  the  slant  range  from  the  project  ship  to  the 
target  at  the  time  of  Initial  acquisition 
(MOEjg  * Average  Initial  acquisition  time,  which  Is  defined 
as  the  elapsed  time  from  designation  to  GMFCS  lock 
(M0E)3  ■ Average  final  acquisition  range,  which  Is  defined 
as  the  slant  range  from  the  project  ship  to  the 
target  at  the  time  of  final  acquisition 
(M0E)4  ■ Average  final  acquisition  time,  which  Is  defined  as 

the  elapsed  time  from  designation  to  final  acquisition 
(MOE)g  ■ Tracking  quality,  which  Is  defined  as  the  percentage 
of  time,  from  Initial  acquisition  to  end-of-run, 
during  which  the  GMFCS  speedgate  was  locked-on  the 
target 

(MOE)g  ■ Acquisition  success  rate 

. Number  of  targets  acquired 
/Number  of  target  acquisition^ 

' opportunities  ' 

ASSUMPTIONS: 

(1)  In  order  to  be  considered  a valid  acquisition,  the  GMFCS  lock 
had  to  be  held  continuously  for  at  least  10  secs. 

(2)  Final  acquisition  occurred  when  the  GMFCS  achieved  a lock-on 
which  was  continuous  until  the  target  passed  the  minimum  GMFCS 
tracking  range,  or  turned  out-bound  (end-of-run). 

REFERENCES:  (1)  Final  Report  on  Project  F/0237 

"Conduct  a Fleet  Operational  Investigation  of  Tartar 
Weapon  System  Capability  Against  Various  Threats" 

13  Dec.  1968,  SECRET 
(2)  Final  Report  on  Project  C/S50 

"Conduct  a Concurrent  Evaluation  of  the  Basic  Point  Defense 
Surface  Missile  System  as  Installed  In  a Destroyer  Type  Ship" 
7 Nov.  1968,  SECRET 
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TABLE  B-2  Operational  Test  & Evaluation 
MOE  Data  Base  (Continued) 


\ 

J 

i 

! 

J 

I 


Area:  Infrared  and  Optical  Detection  (IOD) 


CODE 

ITEM 

1001 

Infrared  Wake  Detector 

I0D2 

IR  Decoy 

1003 

Marine  Location  Marker  (EX-19 

1 

n»  « 

* 

I 


i 


EX-20) 
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I 


Infrared  and  Optical  Detection  (IOD) 

1001  - Infrared  Wake  Detector 

DESCRIPTION:  This  Infrared  equipment  Is  designed  to  detect  surface  wakes 
generated  by  submarines  by  presenting  to  an  operator  a thermal  picture  of 
the  sea  surface. 

(1)  SPECIFIC  OBJECTIVE:  Determine  wake  detection  capability. 

(M0E)<|  ■ Average  submarine  wake  persistence  time  (WPT) 
as  a function  of  sea  state 

(MOEjg  * Average  detectable  wake  persistence  time  (DWPT), 
which  Is  defined  as  that  portion  of  the  measurable 
wake  which  can  be  detected  by  semlalerted  operators 
using  random  crossing  angle  airplane  passes. 

ASSUMPTION:  The  DWPT,  while  not  directly  known,  falls  between  the 
time  of  last  detection  and  the  time  of  no  detection.  The  ratio  of 
the  time  difference  between  COMEX  and  the  time  over  the  buoy*  on 
last  wake  detection  by  either  operator,  to  the  measurable  WPT  was 
determined  for  each  submarine  run  and  these  ratios  averaged  to 
obtain  a lower  limit.  The  same  procedure  was  followed  using  the 
time  difference  from  COMEX  to  the  time  over  the  buoy  with  first 
"no  detectlun"  by  both  operators  to  obtain  the  upper  limit.  These 
ratios  are  used  to  express  the  limits  of  DWPT  as  a percent  of  WPT. 
(*N0TE:  Flashing  light  buoy,  ejected  by  the  submarine,  was  used 
to  mark  submarine  COMEX.) 

(2)  SPECIFIC  OBJECTIVE:  Determine  operator  classification  capability. 

(MOE)^  ■ Probability  of  correct  classification  as  sub- 
marine 

. Number  of  correct  submarine  classifications 
/Number  of  submarine  classification^ 

'opportunities  / 
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1001 


(M0E)2 


Probability  of  correct  classification  as  non- 
submarine 


/Humber  of  correct  non- submarine 
'classifications 


REFERENCE:  Final  Report  on  Project  F/0  143 
(Title  Classified) 

3 Jan.  1966,  SECRET 
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I0D2  - IR  Decoy 

DESCRIPTION:  This  Is  a hand  launched  flare  which  Is  Intended  to  decoy  an 
Infrared  homing  anti ship  missile  away  from  small  combatants. 

(1)  SPECIFIC  OBJECTIVE:  Determine  the  capability  of  a single  flare  to 
cause  an  IR  seeker  to  break-lock  on  a destroyer  type  ship  under 
conditions  of  various  ship  IR  signatures. 

MOE  » Probability  of  seeker  break-lock  on  ship 

/Number  of  times  flare  caused  seeker  to\ 

\ break-lock  on  ship  / 

Number  of  times  seeker  locked-on  ship 

(2)  SPECIFIC  OBJECTIVE:  Determine  capability  of  a single  flare  to  a decoy 
IR  seeker. 

(HOE) ^ ■ Mean  maximum  range  the  IR  seeker  attained  Its 
Initial  lock-on  the  flare 

(HOEjg  * Mean  maximum  range  at  which  the  seeker  attained 
a tight  lock-on  the  flare 

(3)  SPECIFIC  OBJECTIVE:  Determine  capability  of  an  array  of  flares  to 
decoy  IR  seeker. 

MOE  ■ Probability  seeker  Is  attracted  to  the  array  of 
flares 

/Number  of  times  seeker  was  attracted  to  the\ 

„ l array  of  flares / 

/Number  of  attempts  to  attract  the  seeker \ 

\by  an  array  of  flares  ' 

(4)  SPECIFIC  OBJECTIVE:  Determine  the  capability  of  an  array  of  flares 
to  cause  and  maintain  break-lock  on  a destroyer  type  ship. 

MOE  ■ Probability  that  flare  array  successfully  broke  lock 

and  maintained  seeker  decoy 

/Number  of  times  flare  array  caused  seeker\ 
m \to  break-lock  on  ship  and  not  reacoulre  / 

/Humber  of  times  seeker  Initial ly  \ 

\locked-on  ship  / 

REFERENCE:  Final  Report  on  Project  0/S165 
(Title  Classified) 

10  Feb.  1971,  SECRET 
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1003  - Marine  Location  Marker 


DESCRIPTION:  This  Is  an  aircraft  launched  location  marker  which  Is  designed 
to  produce  continuous  clouds  of  colored  smoke  for  a fixed  period  of  time. 

(1)  SPECIFIC  OBJECTIVE:  Evaluate  visibility  of  marker. 

(MOE)-j  * Minimum  visibility  range  for  given  sea  state 
(M0E)2  * Maximum  visibility  range  for  given  sea  state 

REFERENCE:  Final  Report  on  Project  F/0  134  FY63 

"Operational  Investigation  of  Marine  Location  Markers 
EX-19  and  EX-20" 

6 June  1963,  UNCL. 
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Operational  Test  & Evaluation 
MOE  Data  Base  (Continued) 


TABLE  B-2 

♦ 


f 

t 


4 


Area:  Missiles  (M) 


COPE 

ITEM 

Ml 

Alr-to-AIr  Missile  (AIM-9C) 

M2 

Alr-to-Surface  Anti-Radiation  Missile 
(YAGM-45A  SHRIKE) 

M3 

Alr-to-Surface  Missile  (AGM-12B  Bull  pup) 

M4 

Surface-to-AIr  Missile 

M4-1 

IR  Missile  (REDEYE) 

M4-2 

Shipboard  Surface-to-AIr  Missile 
(STANDARD) 

M5 

Rocket  Propelled  Ballistic  Missile 
System  (Mk  1 Mod  0 (TERNE  III)) 
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MISSILES  (M) 


Ml  - Alr-to-AIr  Missile 


DESCRIPTION:  This  Is  a supersonic,  air-to-air  guided  missile  employing 
semi-active  radar  head,  torque-balance  control,  and  proportional  navigation. 
The  missile  functions  In  two  modes,  semi-active  and  passive.  In  the  semi- 
active mode,  the  missile  homes  on  the  pulsed  radar  energy  emitted  by  the 
launching  aircraft  and  reflected  off  the  target  Into  the  radar  seeker.  In 
the  passive  mode,  the  missile  homes  on  the  target's  radar  jammer. 


(1)  SPECIFIC  OBJECTIVE:  Determine  the  kill  capability  against  airborne 
targets. 

MOE  ■ Single  shot  kill  probability 


where 

Rn 


IE 


rr  rl  rg  rf  rle 


reliability  of  the  launching  aircraft  radar 

missile  launch  reliability 

Number  of  successful  launches 
Number  of  valid  > npts  to  fire 

missile  guidance  • ©liability 

Number  of  guidance  successes 
Number  of  successful  launches 

fuzing  reliability 

lethality  of  the  warhead/fuze  combination 


DATA  REQUIREMENTS  SUMMARY: 

DATA  ITEM 

rr,  Rl,  Rq,  Rf 

rle 


FIRING 

EXERCISES 


LABORATORY  TESTS, 
SIMULATIONS.  ETC. 


REFERENCE:  Third  Partial  Report  on  Project  C/Vl  FY61 

"Operational  Evaluation  of  the  AIM-9C  (Mk  30)  Guided  Missile" 
2 Aug.  1965,  CONF. 


M2  - Alr-to-Surface  Anti-Radiation  Missile 


DESCRIPTION:  This  Is  a passive  alr-to-surface  missile  designed  to  home  on 
radar  transmitters. 

(1)  SPECIFIC  OBJECTIVE:  Determine  the  capability  of  the  system  to  Indicate 
to  the  pilot  whether  or  not  a radar  target  Is  radiating. 

(MOE)^  * Percent  of  runs  on  which  the  pilot  was  able  to 

determine  whether  or  not  the  primary  radar  target 
was  radiating  between  the  initial  point  (IP)  and 
the  pull-up  point  (PUP) 

(MOEjg  * Percent  of  runs  on  which  the  pilot  was  able  to 
determine  that  the  primary  target  commenced 
radiating  after  the  pilot  passes  IP 

(MOE),  * Percent  of  runs  on  which  the  pilot  correctly 

determined  that  the  pulse  repetition  rate  (PRR) 
of  the  primary  target  was  low  (l.e.,  not  In  the 
missile  firing  mode),  given  that  the  pilot 
recognized  that  the  primary  target  was  radiating 
between  IP  and  PUP 

(M0E)4  ■ Percent  of  runs  on  which  the  pilot  correctly 

determined  that  the  pulse  repetition  rate  (PRR) 
of  the  primary  target  was  high  (l.e..  In  the 
missile  firing  mode),  given  that  the  pilot  rec- 
ognized that  the  primary  target  was  radiating 
between  IP  and  PUP 

(2)  SPECIFIC  OBJECTIVE:  Determine  the  capability  of  the  system  to  indicate 
to  the  pilot  whether  or  not  he  was  being  tracked  by  gun  fire  control 
radars. 

(M0E).|  ■ Percent  of  runs  on  which  the  pilot  was  able  to 
determine  that  a gun  fire  control  radar  was 
tracking  the  aircraft 

(M0E)2  * Percent  of  runs  on  which  the  pilot  correctly 

determined  whether  the  radar  was  left,  right  or 
ahead,  given  that  the  pilot  recognized  that  a 
gun  fire  control  radar  was  tracking  the  aircraft. 
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(3)  SPECIFIC  OBJECTIVE;  Determine  kill  capability  against  radar  targets. 
MOE  ■ Single  shot  kill  probability 


where 


V k 

Rmf  “ flight  reliability 

Ra  R_  R* 
e g f 

kill  probability  against  a given  target, 

assuming  a reliable  missile 

launch  reliability 

Number  of  missiles  launched 
Number  of  launch  attempts 


guidance  reliability 

/Number  of  missiles  which  satisfactorily^ 

v guided  to  target / 

Number  of  missiles  launched 

fuzing  reliability 

/Number  of  missiles  which  satisfactorily^ 

'fuzed  ' 

/Number  of  mlsslles  which  satisfactorily^ 
'guided  to  target  ' 


DATA  REQUIREMENTS  SUMMARY; 

LABORATORY  TESTS, 

DATA  ITEM  FIRING  EXERCISES  SIMULATIONS.  ETC. 

Re‘  Rg*  Rf  x 

\ .* 

REFERENCE:  First  Partial  Report  on  C/Y9 

"Concurrent  Evaluation  of  the  SHRIKE  Guided  Missile  System, 
YAGM-45A" 

13  March  1967,  SECRET 
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M3  - Alr-to-Surface  Missile 

DESCRIPTION:  This  Is  a supersonic  alr-to-surface,  line  of  sight  (LOS) 
radio  command  guided  missile.  This  missile  Is  designed  to  be  used  by 
attack  class  airplanes  against  small  tactical  targets  and  to  permit  the 
attacking  airplane  to  remain  beyond  the  effective  small  arms  envelope. 

(1)  SPECIFIC  OBJECTIVE:  Determine  performance  against  surface  targets. 

(MOE)^  ■ Maximum  effective  slant  range  as  a function  of 
launch  mode  (such  as  level  flight  or  LOS  at 
given  dive  angle) 

(MOEjg  * Circular  Error  Probable  (CEP)  about  the  aim 

point  In  the  horizontal  plane  through  the  target 
(MOE)^  ■ Circular  Error  Probable  (CEP)  about  the  aim  point 
In  the  plane  normal  to  the  launch  LOS. 

ASSUMPTION:  Miss  distance  Is  the  distance  as  measured  In  the  plane  per* 
pendlcular  to  the  line  of  sight  at  time  of  launch  and  passing  through 
the  target  center. 

REFERENCE:  Final  Report  on  Project  F/0186 

"Fleet  Operational  Investigation  of  AGM-12B  (Bull pup)  Missile 
System" 

2 Feb.  1966,  CONF. 
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M4  - Surface-to-AIr  Missile 
M4-1  IR  missile  (REDEYE) 

DESCRIPTION:  This  Is  a man-transportable,  shoulder  fired,  surface-to-air 
Infrared  homing  guided  missile  weapon  system  used  against  attacking  air- 
craft, Including  single  engine  propeller  and  jet  aircraft. 

(1)  SPECIFIC  OBJECTIVE:  Determine  tracking  capability  against  air  targets 
In  the  at-sea  environment. 


(HOE), 

(moe)2 


(hoe)3 


Average  tracking  error  (deg) 

Percent  targets  successfully  engaged 

Number  of  targets  engaged ]QQ 

/Number  of  target  engagement} 

^opportunities  / 

Percent  of  raids  on  which  tracking  error  was  greater 


than  the  maximum  acceptable  error 


'Number  of  raids  on  which  tracking  error 
was  greater  than  the  maximum  acceptable 

, error t 

Number  of  raids  engaged 


x 100 


(2)  SPECIFIC  OBJECTIVE:  Determine  detection  and  acquisition  capability. 


(NOE)^  ■ Mean  (visual)  detection  range 

(M0E>2  * Mean  target  acquisition  range 

(M0E)3  ■ Percent  raids  visually  acquired 

. Number  of  raids  acquired lnn 

Number  of  acquisition  attempts  uu 


(3)  SPECIFIC  OBJECTIVE:  Determine  missile  Intercept  capability. 

MOE  * Probability  of  target  Intercept  within  a given  altitude 
band 

, Number  of  target  Intercepts 
Number  of  missiles  fired 

REFERENCES:  (1)  Final  Report  on  Project  0/S126 

"Conduct  an  Operational  Evaluation  of  the  REDEYE  Missile 
for  Use  from  PTF  Craft  Against  Attacking  Aircraft,  to 
Include  Single  Engine  Propeller  Aircraft" 

21  Sept.  1967,  CONF. 
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(2)  Final  Report  on  Project  0/S145 

"Conduct  an  Operational  Evaluation  of  the  REDEYE  Weapon 
System" 

23  Oct.  1969,  CONF. 

M4-2  Shipboard  surface-to-air  missile 

DESCRIPTION:  This  system  Is  designed  to  enhance  the  anti-air  warfare 
capability  of  a surface  ship  by  providing  a surface-to-air  missile 
capability. 

(1)  SPECIFIC  OBJECTIVE:  Evaluate  overall  firing  capability  of  the  missile 

against  air  targets. 

NOE  ■ Overall  success  rate 

" Rsl  Rfp  Rmr  Rhr  Rfr 

where 

RS1  ■ launch  phase  success  rate 

. Number  of  successful  launches 
Number  of  missile  launch  attempts 

Rfp  « GMFCS  and  personnel  success  rate 

. Number  of  valid  tests 
Number  of  flight  tests 

Rmr  ■ missile  reliability 

Number  of  missiles  which  do  not  fall 

Number  of  missiles  with  an  opportunity  to  home 

R^r  ■ homing  success  rate 

/Number  of  missiles  which  home  to\ 

■ * successful  Intercept  / 

/Number  of  missiles  which  do\ 

\not  fall  ' 

Rfr  ■ fuze  reliability 

/Number  of  missiles  with  successful \ 

■ 'fuze  operation  

/Number  of  missiles  which  home  to  a\ 

'successful  Intercept  / 

ASSUMPTION:  A valid  test  Is  assumed  to  be  a test  In  which  the 
specified  test  environment,  test  conditions  and  missile  per- 
formance were  such  that  the  missile  system  performance  against 
the  (simulated)  threat  coult  be  evaluated. 
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(2)  SPECIFIC  OBJECTIVE:  Determine  Intercept  capability  against  airborne 
targets. 

MOE  ■ Overall  success  rate,  which  Is  defined  as  the  prob- 
ability that  the  shipboard  system  will  not  fall  either 
before  or  during  missile  flight,  and  that  the  missile 
will  home  to  a successful  Intercept  with  proper  fuze 
action,  or  a direct  hit  Is  achieved,  killing  the  target 

* Pmr  %h 

where 

* missile  round  success  rate,  which  Is  defined  as  the 

mr 

probability  that  a missile  will  home  to  a successful 

Intercept  with  proper  fuze  action,  or  a direct  hit  Is 

achieved  killing  the  target,  given  that  the  shipboard 

system  functions  properly 

(Number  of  missiles  which  home  to  a successful  \ 

Intercept  with  proper  fuze  action,  or  a direct) 

hit,  killing  the  target  / 

" Number  o^  vaUd  missile  firings 

Psh  " ^ipboard  system  reliability,  which  Is  defined  as  the 

probability  that  a shipboard  fire  control  system  will 

properly  support  the  missile  firing 

(Number  of  times  the  shipboard  fire  control  system 
properly  supported  the  missile  firing  Independent 

_ of  missile  success  or  failure 

" /Number  of  valid  mlss'He  Wrings  less) 

'undetermined  failures  ' 

LOWER  LEVEL  EVALUATION: 

P_„  ■ missile  round  success  rate 
mr 

■ p p. 
re  1e 

where 

Pre  * missile  reliability,  which  Is  defined  as  the  prob- 
ability that  a missile  will  home  successfully  to 
the  vicinity  of  the  Intercept  region,  given  that 
the  shipboard  system  functions  properly 


B-lll 


i 


-«* 

j 


) 


/Number  of  times  missile  homed  successfully  to\ 
(the  vicinity  of  the  Intercept  region  and  ship-) 
m \board  system  functioned  properly  / 

/Number  of  missile  homing  attempts  when  sh^p-\ 
\board  system  functioned  properly  ' 

P^e  ■ Intercept  effectiveness,  .yhlch  is  defined  as  the 
probability  that  a reliable  missile,  having  homed 
to  the  Intercept  region  with  proper  shipboard 
system  support,  will  enter  region  R (a  specified 
maximum  distance  from  the  target)  and  the  fuze  will 
function  properly,  or  the  missile  will  hit  and 
destroy  the  target 

/Number  of  times  the  missile  m1ss\ 

- 'distance  did  not  exceed  R / 

(Number  of  times  miss ‘lie  homed  \ 

successfully  to  the  vicinity  of  the  J 
Intercept  region  and  shipboard  system/ 
functioned  properly 

(3)  SPECIFIC  OBJECTIVE:  Determine  guidance  capability. 


MOE  ■ Guidance  success  rate,  which  Is  defined  as  the 

probability  that  the  missile  will  properly  home 

to  within  a maximum  miss  distance  R from  the  target 

(Number  of  times  missile  properly  homed\ 
to  within  a maximum  miss  distance  R ) 

_ from  the  target /_ 

Number  of  guidance  attempts 

REFERENCES:  (1)  Final  Report  on  Project  0/S138 

"Conduct  an  Operational  Evaluation  of  the  STANDARD  Missile 
In  the  TERRIER  and  TARTAR  Weapons  Systems" 

1 May  1970,  SECRET 
(2)  Final  Report  on  Project  C/S50 

"Conduct  a Concurrent  Evaluation  of  the  Basic  Point  Defense 
Surface  Missile  System  as  Installed  In  a Destroyer  Type  Ship" 
7 Nov.  1968,  SECRET 


B-112 


M5 


MS  - Rocket  Propelled  Ballistic  Missile  System 

DESCRIPTION:  The  system  Is  designed  to  deliver  a straight  line  pattern 
of  6 rocket  propelled  ballistic  missiles  normal  to  the  computed  target 
course. 

SPECIFIC  OBJECTIVE:  Determine  the  hit  probability  of  the  system  against 
non -maneuvering  targets. 

HOE  - HU  probability  • gj£  °J  jflMg 

REFERENCE:  Final  Report  on  Project  C/S23  FY  62 

"Concurrent  Evaluation  of  Anti-Submarine  Weapon  System 
Mk  1 Mod  0 (TERNE  III)" 

15  Nov.  1962,  CONF. 
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TABLE  B-2  Operational  Test  & Evaluation 
MOE  Data  Base  (Continued) 


Area:  Navigation  & Guidance  (NG) 


COPE 

ITEM 

NG1 

Shipboard  Navigation  System  (OMEGA  Receiver) 

NG2 

TACAN  Beacon  System  (AN/URN-20) 

NG3 

Submarine  Navigation  Set  (AN/BRN-7 

OMEGA  Receiver) 

NG4 

Aircraft  Navigation  System  (AN/APN-126) 
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NAVIGATION  A GUIDANCE  (NG) 


NG1 


NG1  - Shipboard  Navigation  System 

DESCRIPTION:  The  system  Is  a Very  Low  Frequency  (VLF)  long  range  electronic 
navigation  system  using  phase  comparison  of  CW  signals  from  two  shore-based 
transmitting  stations  to  give  a hyperbolic  line  of  position. 

(1)  SPECIFIC  OBJECTIVE:  Evaluate  geographic  navigational  position  accuracy. 

MOE  ■ Average  (radial)  position  error  (In  yards) 

REFERENCE:  Final  Report  on  Project  C/S21  FY  61 

"Concurrent  Evaluation  of  the  Omega  Navigation  System  Utilizing 
the  Type  II  Omega  Receiver" 

7 Sept.  1962,  CONF. 


NG2 


NG2  - TACAN  Beacon  System 

DESCRIPTION:  This  Is  a short  range  air  navigation  aid  Intended  for  ship 
or  shore  Installation.  It  transmits  signals  which  provide  a properly 
equipped  aircraft  with  distance  and  bearing  Information  relative  to  the 
Installation. 

(1)  SPECIFIC  OBJECTIVE:  Evaluate  system  accuracy  performance. 

(MOE)^  ■ Average  distance  error  as  percent  of  range 
(H0E>2  ■ Cumulative  distribution  of  range  error  as 
percent  of  range 

(M0E)3  ■ Percent  of  bearing  errors  within  maximum 
acceptable  bearing  error 

REFERENCE:  Final  Report  on  Project  0/S1 55 

"Conduct  an  Operational  Evaluation  of  the  AN/URN-20  TACAN 
Beacon  System" 

25  Aug.  1970,  UNCL. 
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NG3  - Submarine  Navigation  Set 

DESCRIPTION:  This  receiver  Is  primarily  designed  to  supply  the  ubmarlne 
with  Instantaneous  navigation  Information  when  operating  In  the  OMEGA 
signal  environment.  Additionally,  It  provides  a dead  reckoning  capability 
when  no  OMEGA  signals  are  received  or  during  submerged  submarine  operations. 

(1)  SPECIFIC  OBJECTIVE:  Determine  navigation  accuracy. 

(MOE)^  ■ RMS  (root-mean-square)  error  from  actual 
position 

(MOE )2  • RMS  error  referenced  to  the  time  position 
(MOE)^  * Mean  error  bias  In  latitude  referenced  to 
actual  position 

(MOE * Mean  error  bias  In  longitude  referenced  to 
actual  position 

(MOE)g  ■ Circular  error  probable  (CEP)  about  the  mean 
bias  point  referenced  to  actual  position. 

(2)  SPECIFIC  OBJECTIVE:  Determine  dead  reckoning  capability. 

MOE  ■ Mean  DR  (dead  reckoning)  radial  error  (nm) 

REFERENCE:  Final  Report  on  Project  0/S170 

"Operational  Evaluation  of  the  AN/BRN-7  OMEGA  Receiver 
In  Submarines" 

2 June  1972,  UNCL. 
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NG4  - Aircraft  Navigation  System 

DESCRIPTION:  This  Is  a continuous  wave  doppler  radar  navigation  system 
designed  to  provide  continuous  readouts  of  track,  ground  speed,  drift 
angle,  latitude,  longitude  and  true  bearing  and  great  circle  distance  to 
a selected  target  and  destination. 

(1)  SPECIFIC  OBJECTIVE:  Evaluate  system  accuracy  performance. 

(MOE)^  « Mean  navigation  error  In  range  (X  distance  traveled) 
(MOEjg  ■ Mean  cross-track  error 

ASSUMPTIONS: 

(1)  Range  error  Is  the  component  of  total  error  which  Is  parallel  to 
the  ground  track  between  the  target  and  base. 

(2)  Errors  In  navigation  are  determined  by  recording  the  computed 
latitude  and  longitude  when  over  the  target  and  comparing  them 
to  actual  latitude  and  longitude. 

REFERENCE:  First  Partial  Report  on  Project  0P/V261/H 

"Evaluation  of  the  Automatic  Navigator  AN/APN-126" 

10  May  1960,  UNCL. 


TABLE  B-2  Operational  Test  & Evaluation 
MOE  Data  Base  (Continued) 


Area;  Ordnance  (0) 


COPE 

ITEM 

01 

Bomb  Cluster  Weapon  (CBU-59/B  APAM, 
Mk  15  Mod  0 SADEYE) 

02 

Television  Guided  Bomb  (Walleye  Mk  1 Mod  0. 
Walleye  II  Mk  5) 

03 

Laser  Guided  Bomb  (A-6A/RABFAC/Paveway) 

04 

Aircraft  Gun  Pod  (Mk  4 Mod  0,  GPU-2/A) 

05 

Rocket  (ZAP) 

06 

Rocket  Assisted  Depth  Bomb  (SUBROC) 

07 

Mine  Hunting  and  Surveillance  System 
(SEANETTLE) 

08 

Torpedo 

08-1 

Wire-guided  torpedo  (Mk  48  Mod  1) 

08-2 

Rocket  Assisted  Torpedo  (ASROC) 

08-3 

Active/Passive  Torpedo  (Mk  46  Mod  1) 

09 

Magnetic  Influence  Bottom  Mine 
(Destructor  Mk  30  Mod  0) 
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01 


ORDNANCE  (0) 


01  - Bomb  Cluster  Weapon 

DESCRIPTION:  This  Is  a cluster  weapon  designed  for  use  against  personnel 
and  materiel  targets  Including  trucks,  light  and  medium  tanks,  aircraft, 
and  surface  warships. 

(1)  SPECIFIC  OBJECTIVE:  Determine  weapon  delivery  accuracy. 

MOE  ■ Circular  error  probable  (CEP)  as  a function  of  dive  angle 
and  delivery  mode 

ASSUMPTION:  A circular  normal  distribution  of  Impact  points  Is  assumed. 

(2)  SPECIFIC  OBJECTIVE:  Determine  bomblet  pattern. 

MOE  ■ Percentage  of  bomblets  within  the  effective 
pattern 

/Number  of  bomblets  falling  w1th1n\ 

_ \the  effective  pattern ) lnft 

Number  of  bomblets  In  weapon  x uu 

ASSUMPTION:  Due  to  the  Inability  during  testing  to  locate  all  (Inert) 
bomblets  on  the  ground  following  any  drop,  two  estimates  of  this 
percentage  can  be  made.  The  first,  or  low  estimate,  pessimistically 
assumes  that  all  unobserved  Inert  bomblets  fell  outside  the  effective 
pattern;  hence  the  number  of  observed  bomblets  falling  within  the 
effective  pattern  Is  divided  by  the  total  number  of  bomblets.  A 
second  more  optimistic  estimate  assumes  that  the  numbers  of  unobserved 
bomblets  falling  within  and  outside  the  effective  pattern  are  propor- 
tional to  the  observed  numbers  of  bomblets  falling  within  and  outside 
the  pattern;  It  Is  further  assumed  that  the  same  constant  of  propor- 
tionality holds  for  both  cases.  The  estimate  of  the  percentage  Is  then 
obtained  by  dividing  the  number  of  observed  bomblets  within  the  pattern 
by  the  total  number  of  observed  bomblets.  These  two  estimates  provide 
low  and  high  estimates,  respectively,  of  the  true  value  of  the  percentage. 

(3)  SPECIFIC  OBJECTIVE:  Evaluate  kill  capability  against  surface  targets. 
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(MOE)-j  ■ Mean  fractional  coverage 

a Pattern  lethal  area 
Total  pattern  area 

(MOEjg  ■ Probability  of  target  kill 

- f (x1 x5) 

where 

* circular  error  probable  of  weapon  burst  point 
Xg  ■ number  of  bomblets  released 

X3  * target  size 

X^  ■ bomblet  lethal  radius 

Xg  ■ pattern  size 

(NOTE:  (M0E)2  Is  determined  via  a computer  program 

developed  by  the  Naval  Weapons  Center.) 

ASSUMPTION:  Pattern  lethal  area  Is  the  sum  of  the  Individual 
bomblet  lethal  areas,  counting  Overlapping  portions  only  once. 

REFERENCES:  (1)  Final  Report  on  Project  0/V98 

"CBU-59/B  APAM  Bomb  Cluster  Weapon  System" 

26  Sept.  1973,  CONF. 

(2)  Final  Report  on  Project  0/V28,  Section  A,  Task  6 
"Mk  15  Mod  0 SADEYE  Weapon  System" 

26  March  1968,  SECRET 


02 


02  - Television  Guided  Bomb 

DESCRIPTION:  This  Is  a television  guided  glide  bomb  which  uses  automatic 
video  tracking  for  homing  and  guidance  against  visually  acquired  surface 
targets. 

(1)  SPECIFIC  OBJECTIVE:  Evaluate  bomb  delivery  accuracy  performance. 

(M0E)]  - Hit  probability 

, Number  of  target  hits 
Number  of  bombs  dropped 

(M0E)2  * Average  miss  distance 

(MOE)j  ■ Median  miss  distance 

(2)  SPECIFIC  OBJECTIVE:  Evaluate  target  acquisition  capability. 

(M0E)1  * Average  lock-on  range 

(M0E>2  ■ Minimum  lock-on  range 

(MOE)^  * Maximum  lock-on  range 

REFERENCES:  (1)  Final  Report  on  CNO  Project  0/V52 

"Walleye,  Mk  1 Mod  0" 

26  March  1968,  SECRET 
(2)  Final  Report  on  Project  F/0263 

"Conduct  a Fleet  Operational  Evaluation  of  the  Guided 
Weapon  Mk  5 (Walleye  II)" 

14  Dec.  1972,  CONF. 
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03  - Laser  Guided  Bomb 

DESCRIPTION:  This  Is  an  aircraft  delivered  bomb  which  acquires  reflected 
laser  energy  from  an  Illuminated  target. 

(1)  SPECIFIC  OBJECTIVE:  Evaluate  target  acquisition  capability. 

MOE  ■ Average  normalized  acquisition  range 

ASSUMPTION:  Normalized  range,  Rn,  In  meters  Is  computed  from 
the  equation 


where 

R ■ range  (in  maters)  from  target  to  seeker 
E ■ laser  energy  (mlllljoules) 

En  « normalized  laser  energy  (mlllljoules) 

(2)  SPECIFIC  OBJECTIVE:  Evaluate  weapon  delivery  accuracy. 

(MOE ) i « Circular  error  probable  (CEP) 

(MOE) 2 ■ Probability  of  weapon  release  within  envelope  as  a 
function  of  CEP  for  give*  celling  height  and  release 
conditions 

REFERENCE:  Final  Report  on  Project  F/0257 

"Conduct  of  a Fleet  Operational  Investigation  of  the  A-6A/ 
RABFAC/Paveway  Concept" 

5 April  1972,  CONF. 
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04  - Aircraft  gun  pod  ^ — ' 

OESCRIPJlJlW^^iTnTls  a self-contained  gun  pod  for  use  on  aircraft. 

(1)  SPECIFIC  OBJECTIVE:  Evaluate  firing  capability  against  airborne 
targets. 

(MOE)^  ■ Percent  sorties  on  which  hits  occur 

/Number  of  sorties  on\ 
i Which  hits  occur  / inn 

Number  of  sorties 

(MOE)g  ■ Probability  of  1 00%  gun  pod  flreout 

9 Number  of  round  fired 
Number  of  rounds  attempted 

(2)  SPECIFIC  OBJECTIVE:  Evaluate  delivery  accuracy  of  system. 

(MOE)j  ■ Circular  error  probable  about  the  target 

(M0E)2  « Circular  error  probable  about  the  mean  point 
of  Impact 

(MOE)^  ■ Mean  point  of  Impact  range 

(M0E)4  ■ Mean  point  of  Impact  deflection 

REFERENCES:  (1)  Final  Report  on  Project  0/V37 

"Operational  Evaluation  of  the  Gun  Pod,  Mk  4 Mod  0 
(F-4  Alr-to-AIr  Phase)’1 
17  March  1969,  CONF. 

(2)  First  Partial  Report  on  Project  0/V95,  Phase  I 

"Conduct  an  Operational  Evaluation  of  the  2Gmm  GPU-2/A 
Lightweight  Gun  Pod" 

12  June  1973,  CONF. 
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05  - Rocket 

DESCRIPTION:  This  Is  a hypervelocity,  air-launched,  free  rocket  employing 
a flechette  warhead  activated  by  a radar  altimeter  fuze. 

(1)  SPECIFIC  OBJECTIVE:  Evaluate  kill  capability  against  flak  sites  and 

other  light  or  medium  material  targets. 

(M0E).|  ■ Probability  of  suppression  of  an  enemy  flak  site 
(M0E)2  ■ Probability  of  kill  against  light  or  medium 
material  targets 

(NOTE:  These  MOE's  were  computed  using  simulation  models 
developed  by  the  Naval  Weapons  Center.) 

REFERENCE:  First  Partial  Report  on  Project  0/V86 

"Conduct  an  Operational  Evaluation  of  the  ZAP  (Zero  Anti- 
aircraft Potential)  Rocket" 

24  April  1970,  SECRET 
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06  - Rocket  Assisted  Depth  Bomb 

DESCRIPTION:  This  Is  a rocket  assisted  depth  bomb  fired  from  a sub- 
marine at  a submarine  target. 

(1)  SPECIFIC  OBJECTIVE:  Determine  the  capability  to  deliver  the  warhead 
within  "lethal"  radius  of  a submarine  target. 


(MOE)^  ■ Probability  of  seaworthy  Impairment  for  given 
impairment  radius  as  a function  of  burst  depth, 
type  of  target  and  target  depth 


(M0E)«  ■ Probability  of  mobility  Impairment  for  given 

Impairment  radius  as  a function  of  burst  depth, 
type  of  target  and  target  depth 


9 


Mobl 1 1 ty 
Impairment 
radius 


/ 


CEP  of 

attack  error, 


2 


(M0E)3  ■ Probability  of  weapon  delivery  Impairment  for  given 
Impairment  radius  as  a function  of  burst  depth, 
type  of  target  and  target  depth 

/weapon  delivery  /CEP  of  \ 2 
, j l Impairment  radius/  attack  error  J 


LOWER  LEVEL  EVALUATION: 


CEP  of  attack  error  ■ median  attack  error,  which  Is  the 

difference  between  actual  point  of 
detonation  and  actual  target 
position  at  time  of  detonation 

• f(X, x5) 
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where 

■ missile  delivery  error,  which  Is  defined  as  the 
difference  between  the  actual  point  of  detonation 
and  the  computed  almpolnt  (l.e.,  the  detonation 
point) 

Xg  ■ almpolnt  error,  which  Is  the  difference  between 
the  correct  almpolnt  for  the  existing  solution 
and  the  almpolnt  set  Into  the  missile 
X3  ■ prediction  error,  which  Is  the  error  In  computing 
the  correct  almpolnt  resulting  from  an  Incorrect 
target  course  and  speed  solution 
X^  ■ location  error,  which  Is  the  difference  between 
the  position  of  the  target  at  tlme-of-flre  (TOF) 
by  fire  control  solution  and  the  actual  target 
position  at  TOF 

Xg  * maneuver  error,  which  Is  the  error  resulting  from 
the  target  not  making  good  Its  actual  TOF  course 

and  speed 

ASSUMPTIONS: 

(1)  Probability  of  seaworthy  Impairment  Is  a measure  of 
damage  which  a submarine's  hull  can  withstand  and 
still  allow  the  submarine  to  remain  afloat.  The  level 
of  seaworthy  Impairment  Is  that  damage  to  the  hull 
sufficient  to  cause  the  submarine  to  be  In  danger  of 
settling  to  the  bottom.  Seaworthy  Impairment  radius 
refers  to  the  range  from  the  target  at  which  a detonation 
will  produce  this  level  of  damage. 

(2)  Probability  of  mobility  Impairment  Is  a measure  of  the 
damage  to  a submarine's  ability  to  maneuver.  The  level 
of  mobility  Impairment  is  that  damage  sufficient  to 
cause  the  submarine  to  lose  steerage  In  a desired 
direction.  Mobility  Impairment  radius  refers  to  the 
range  from  the  target  at  which  a detonation  will  pro- 
duce this  level  of  damage. 
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(3)  Probability  of  weapon  delivery  Impairment  Is  a measure 
of  the  damage  to  a submarine's  fire  control,  sonar,  or 
launch  equipment  such  that  the  capability  to  success* 
fully  and  accurately  launch  Its  store  of  weapons  Is 
curtailed  or  reduced.  The  level  of  weapon  delivery 
Impairment  Is  that  damage  sufficient  to  cause  a low 
probability  of  weapon  launching  and  a corresponding 
lower  probability  of  successful  detonation  In  the  target 
area.  Weapon  delivery  Impairment  radius  refers  to  the 
range  from  the  target  at  which  a detonation  will  produce 
this  level  of  damage. 

(4)  Attack  error  is  the  vectorial  sum  of  the  missile  delivery 
error,  almpolnt  error,  prediction  error,  location  error 
and  maneuver  error. 

(5)  The  distribution  of  attack  error  Is  circular  normal. 


DATA  REQUIREMENTS  SUMMARY:  ^ 

DATA  ITEM 
Attack  error 

Seaworthy  Impairment  radius 

Mobility  Impairment  radius 

Weapon  delivery  Impairment 
radius 


ATTACK  WEAPON  TESTS, 

EXERCISES  LABORATORY  TESTS,  ETC. 

X 

X 

X 

X 


REFERENCE:  Final  Report  on  Project  C/S17 

"Concurrent  Evaluation  of  the  SUBROC  Weapon  System" 
21  Jan.  1966,  SECRET 
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07  - Mine  Hunting  and  Surveillance  System 

DESCRIPTION:  A torpedo  shaped,  wire  guided,  self-propelled  underwater 
vehicle  designed  to  neutralize  bottom  mines  through  the  detonation  of  a 
self-contained  warhead  is  used  In  conjunction  with  a mine  hunting  sonar  for 
mine  neutralization  without  the  use  of  underwater  swimmers. 


(1)  SPECIFIC  OBJECTIVE:  Determine  mine  hunting  and  clearance  performance. 


(MOE)-j  ■ Probability  of  mine  neutralization  given 
correct  classification 


(moe)2 


(moe)3 


(moe)4 

(moe)5 

(moe)6 

(moe)7 

(H0E)q 


(M0E)g 


C"  imber  of  correctly  classified1) 

nes  neutralized / 

Number  of  mines  correctly  classified 


Probability  of  mine  correct  classification 
given  detection 


/Number  of  detected  mines  corre 

Iclasslfled 

Number  ol  mine  detections 


■ Percent  of  total  mines  In  field  success- 
fully neutralized 

. Number  of  mines  neutralized  .. 

Number  of  mines  in  field * 100 

* Mean  range  at  which  the  contacts  were 
classified  as  mlnellke  or  non-mlnellke 

■ Mean  time  expended  per  non-mi nel ike  contact 

■ Mean  time  expended  per  minelike  contact 

* Mean  time  expended  In  classifying  a contact 
as  mlnellke 

■ Average  mine  field  clearance  rate 

m Mine  field  area 

Total  time  spent  In  area 

■ Probability  of  hit  as  a function  of  water 

depth  and  sonar  range 

/Number  of  hits  for  given  depth  Interval! 

9 Und  sonar  range  band / 

Number  of  runs 
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SPECIFIC  OBJECTIVE:  Determine  reattack  performance. 

MOE  ■ Percent  of  attempted  reattacks  which  were 
successful 

a Number  of  successful  reattacks 
" Number  of  reattack  attempts 


(3)  SPECIFIC  OBJECTIVE:  Determine  warhead  detonation  performance. 


MOE  ■ Percent  of  attempted  warhead  detonations 
which  were  successful 

. Number  of  successful  warhead  detonations  v iqo 
Number  of  attempted  warhead  detonations 

(4)  SPECIFIC  OBJECTIVE:  Determine  vehicle  placement  accuracy. 

MOE  ■ Average  radial  miss  distance  between  contact  and  Intended 
Impact  point 

REFERENCE:  Final  Report  on  Project  0/S108 

"Conduct  an  Operational  Evaluation  of  Mine  Hunting  and 
Surveillance  System  S2602,  SEANETTLE  Subsystem" 

6 Jan.  1967,  CONF. 


i 
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08  - Torpedo 

08" 1 Wire-guided  torpedo 

DESCRIPTION:  This  Is  a wire-guided  weapon  with  an  active/passive  system 
for  use  against  submarines  and  surface  ships. 

(1)  SPECIFIC  OBJECTIVE:  Determine  performance  against  submarine  and  surface 
ship  targets. 


MOE 


Probability  of  mission  success  (MOMS)  for  given  target 
type,  target  depth,  target  speed,  target  tactic 

(evasion  or  no  evasion)  and  torpedo  search  speed 


Pd  Pc  Ps  % P.  Pv  Pd  Pm  P*  Pk 


where 

Pd  ■ probability  of  detection  given  a target 

m Number  of  target  detections 

" Number  of  target  detection  opportunities 

Pr  * probability  of  correctly  classifying  the  target 

given  target  detection 

/Number  of  correct  classifications) 

m \of  detected  targets  

Number  of  target  detections 

P$  * probability  of  obtaining  a fire  control  solution 

given  classification  and  decision  to  fire 

/Number  of  times  a fire  control  solution) 

■ ‘was  obtained  on  a classified  target  / 

/Number  of  attempts  to  obtain  a fire  Y 
(control  solution  on  a classified  target] 

\once  the  decision  was  made  to  fire  / 

P ■ probability  of  torpedo  enable  given  a decision  to  fire 
© 

a Number  of  times  torpedo  enabled 

Number  of  torpedo  enable  attempts 

P_  ■ probability  of  torpedo  acquisition  given  torpedo 

Q 

enable 

m Number  of  times  torpedo  acquired  target 
/Number  of  acquisition  attempts  for) 

Van  enabled  torpedo  / 
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probability  of  torpedo  validation  given  torpedo 
acquisition 

Number  of  times  torpedo  validation  occurred 
/Number  of  torpedo  validation  attempts\ 

'when  target  was  acquired  / 


probability  of  reaching  close-in  attack  given 
torpedo  validation 

Number  of  times  close-in  attack  Is  reached 
I Number  of  close-in  attack  attempts  when\ 

\ torpedo  validation  has  occurred  ' 

probability  of  reaching  exploder  actuation  range 

given  close-in  attack 


/Number  of  times  exploder  actuation  range 

Vis  reached : 

/Number  of  attempts  to  reach  exploder \ 
lactuatlon  range  In  close-in  attacks  J 

probability  of  exploder  actuation  given 

exploder  actuation  range  Is  reached 

Number  of  exploder  actuations 

/Number  of  exploder  actuation  attempts' 
'within  exploder  actuation  range  / 

probability  of  acceptable  target  damage 

given  exploder  actuation 


/Number  of  times  acceptable  target  damage 

'occurred  upon  exploder  actuation 

Number  of  exploder  actuations 


HIGHER  LEVEL  EVALUATION: 

MOE  - (MOMS)  x (R) 
where 

R * torpedo  In-water  reliability 


a Number  of  torpedoes  that  ran  as  programmed 
Number  of  torpedoes  that  are  launched 


OATA  REQUIREMENTS  SUMMARY; 

ATTACK 

WEAPON  TESTS,  LABORATORY 
TESTS,  COMPUTER  SIMULA- 

DATA ITEM 

EXERCISES 

TIONS,  ETC. 

pd»  Pc’  %•  Pe*  Pa»  Pv»  Pc1 
pm*  px*  pk 

X 

X 
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REFERENCE:  Final  Report  on  Project  0/S167 

"Torpedo  Mk  48  Mod  1 Operational  Evaluation" 

21  Sept.  1972,  SECRET 

08-2  Rocket  assisted  torpedo  (ASROC) 

DESCRIPTION:  This  Is  a rocket  assisted  torpedo  used  against  submarine 

targets. 

(1)  SPECIFIC  OBJECTIVE:  Determine  the  capability  of  the  weapon  system 

against  submarines. 

(MOE)1  - Probability  of  hit 

. Number  of  hits 
Number  of  torpedoes  fired 

(M0E)2  * Total  attack  error  (median),  which  Is  defined 
as  the  distance  between  the  weapon  water  entry 
point  and  the  almpolnt  based  on  the  target's 
actual  position,  course  and  speed  at  the  time 
of  weapon  water  entry 

LOWER  LEVEL  EVALUATION: 

(MOE)2  - f(X; x5) 

where 

X.|  * prediction  error,  which  Is  defined  as  the  error 
In  almpolnt  caused  by  an  Incorrect  solution  for 
target  course  and  speed  at  time  of  fire 
X2  * evasion  error,  which  Is  defined  as  the  error 
resulting  from  evasive  maneuvers  of  the  target 
between  time  of  fire  and  time  of  weapon  water  entry 
Xj  ■ ballistic  error,  which  Is  defined  as  the  horizontal 
distance  from  computed  almpolnt  to  the  point  of 
weapon  water  entry 

X^  ■ sonar  location  error,  which  Is  defined  as  the 
horizontal  distance  from  the  actual  position  of 
the  submarine  to  the  position  of  the  submarine  as 
determined  by  sonar  at  the  time  of  fire 
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Xg  ■ computer  error,  which  is  defined  as  the  difference 
between  the  computed  aimpoint  generated  by  the 
computer  and  the  aimpoint  determined  graphically 
using  the  computer's  solution  for  target  course 
and  speed 

(NOTE:  (M0E)2  Is  the  vectorial  sum  of  the  prediction, 

evasion,  ballistic,  sonar  location  and  computer  errors.) 

REFERENCE:  Second  Partial  Report  on  Project  C/S4  FY60 

"Concurrent  Eva' nation  of  the  ASROC  Weapon  System  Using 
the  Rocket  Thrown  Torpedo  Mk  2" 

29  May  1961,  CONF. 

08-3  Active/passive  torpedo 

DESCRIPTION:  This  is  a high  speed,  active/passive  homing  device  capable 
of  detecting  and  homing  on  submarines. 

(1)  SPECIFIC  OBJECTIVE:  Determine  performance  and  acquisition  capability 

against  both  submarines  and  mobile  acoustic  targets  (MOACT). 

(M0E)1  * Overall  acquisition  probability 

m Number  of  runs  on  which  torpedo  acquired  target 
Number  of  runs  valid  for  overall  acquisition 

(M0E)2  ■ Overall  attack  probability 

/Number  of  runs  on  which  the  torpedo  attacked \ 

, \ the  target  to  hit  or  to  turnaway / 

Number  of  runs  valid  for  overall  attack 

(MOE)^  * Conditional  acquisition  probability 

. Number  of  runs  on  which  torpedo  acquired  target 
/Number  of  runs  valid  for  overaU  acquisition  A 
( excluding  those  runs  which  experienced  type  A 1 
\mal functions  / 

(NOTE:  A type  A malfunction  Is  a destructive  malfunction 
occurring  before  an  acquisition  at  a time  when  acquisition 
and  attack  were  considered  probable.  (M0E)3  Is  a measure 
of  torpedo  acquisition  performance  In  the  absence  of 
destructive  malfunctions.) 
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(M0E)4  ■ Conditional  attack  probability 

/Number  of  runs  on  which  the  torpedo  \ 
a ^attacked  the  target  to  hit  or  to  turnawav/ 

(Number  of  runs  valid  for  overall  attack, 
excluding  those  runs  which  experienced  \ 
type  A or  6 malfunctions  and  those  runs  I 
on  which  the  torpedo  did  not  acquire  the/ 
target 

(NOTE:  A type  B malfunction  Is  a destructive  malfunction 
occurring  before  an  attack,  but  after  at  least  one  acqui- 
sition, at  a time  when  attack  was  still  considered  possible. 
(M0E)4  Is  a measure  of  torpedo  attack  performance,  given 
prior  acquisition.  In  the  absence  of  destructive  malfunctions.) 

REFERENCE:  Final  Report  on  Project  C/Cl 

"Concurrent  Evaluation  of  the  Torpedo  Mk  46  Mod  1" 

17  Oct.  1966,  CONF. 
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09  - Magnetic  Influence  Bottom  Mine 

DESCRIPTION:  This  Is  an  aircraft-planted,  magnetic  influence  bottom  mine 
Intended  primarily  to  Interdict  Indlgeneous  small  craft  carrying  war 
material  on  Inland  waterways.  It  can  also  be  dropped  on  land  for  use  as 
an  anti-vehicle  and  anti-personnel  mine. 

(1)  SPECIFIC  OBJECTIVE:  Determine  the  response  of  the  device  to  small  craft. 

(MOE ) ^ * Probability  that  the  device  will  actuate  when  a 

small -boat  target  passes  directly  over 

/Number  of  times  device  actuated  in  response\ 

m \to  a small -boat  target / 

Number  of  valid  runs  * 

(MOE^  3 Probability  that  the  device  will  actuate  within 

moderate  damage  range  in  response  to  a boat  target 

/Number  of  times  device  actuated  within  moderate\ 

_ xdamaqe  range  in  response  to  a boat  target ' 

Number  of  valid  runs 

(MOE)^  * Probability  of  actuation  versus  lateral  range 
for  given  boat  target 

(2)  SPECIFIC  OBJECTIVE:  Determine  the  response  of  the  device  to  vehicles 

crossing  a bridge. 

MCE  * Probability  that  the  device  will  actuate  and  do 
at  least  moderate  damage  to  a vehicle  passing 
over  a bridge  when  planted  in  a swamp  close  to 
the  bridge 

(Number  of  times  device  actuated  within  moderate\ 
damage  range  in  response  to  a vehicle  passing  1 

over  a bridge / 

Number  of  valid  runs 

(3)  SPECIFIC  OBJECTIVE:  Determine  the  response  of  the  device  to  vehicles 
on  land. 

MOE  = Probability  that  the  device  will  actuate  within 
moderate  damage  range  in  response  to  a vehicle 
when  planted  on  land 

/Number  of  times  device  actuated  within  moderate] 

_ ^damage  range  in  response  to  a vehicle 

Number  of  valid  runs 
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REFERENCE: 


Final  Report  on  Project  C/V14 

"Concurrent  Evaluation  of  the  Destructor  Mk  30  Mod  0" 
12  Feb.  1968,  SECRET 
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TABLE  B-2  Operational  Test  & Evaluation 
MOE  Data  Base  (Continued) 

Area:  Submarines  (S) 


CODE 

ITEM 

SI 

Submarine 

SI -1 

(Submarine  in  Fixed  Barrier  Mission) 

SI -2 

(Submarine  in  Area  Search  Mission) 

SI -3 

(Submarine  In  Surveillance  Aided 
Intercept  Mission) 
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SUBMARINES  (S) 


SI  - Submarine 


SI -1  (Submarine  in  Fixed  Barrier  Mission) 


DESCRIPTION:  The  Fixed  Barrier  Role  is  one  in  which  an  SSK  is  assigned 
a patrol  area  and  the  responsibility  to  detect  and  kill  any  enemy  sub- 
marines that  may  be  encountered  in  the  area. 

(1)  SPECIFIC  OBJECTIVE:  Detect  and  kill  any  enemy  submarine  encountered. 
MOE  * SSK  versus  Transitor  effectiveness  (STE) 


where 

Pp  s probability  that  the  SSK  detects  a transiting  sub- 
marine without  first  being  killed,  given  a detection 
opportunity 

. D _ Number  of  detections  of  a transitor  by  the  SSK 
0"  " Number  of  valid  detection  opportunities  for  the  SSK 

Pc  = probability  that  the  SSK  correctly  classifies  a trans- 
iting submarine  without  being  killed  between  the  time 
of  detection  and  time  of  classification,  given  that 
the  transitor  has  been  detected 

/Number  of  correct  classifications  of  the\ 

_ C _ \ transitor  by  the  SSK ) 

0 " /Number  of  detections  of  the  transitor  by\ 

(the  SSK  that  are  valid  opportunities  for) 
\classification  / 

P^I  = probability  that  the  SSK  makes  an  attack  against  a 

transiting  submarine  without  being  killed  between  the 

time  oy'  classification  and  attack  given  that  the 

transitor  has  been  correctly  classified 

/Number  of  attacks  made  by  the  SSK  against\ 

a A1  _ 'the  transitor 

"C"  " /Number  of  correct  classifications  of  the\ 
(transitor  by  the  SSK  that  are  valid  1 

\approach  opportunities  / 
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P^2  s probability  that  the  SSK  conducts  an  accurate  attack 

{i.e.,  accurate  placement  of  the  weapon  as  evaluated 

when  the  weapon  approaches  the  target  and  not  at  time 

of  fire)  against  a transiting  submarine  without  being 

killed  between  the  time  of  attack  and  the  time  the 

launched  weapon  no  longer  requires  control  by  the  fir 

ing  ship  for  successful  culmination  of  the  attack, 

given  that  an  attack  is  made 

/Number  of  accurately  placed  attacks  by  the\ 

_ A2  _ \ SSK  against  the  transitor : )_ 

ST  /Number  of  attacks  made  by  the  SSK  against  \ 
(the  transitor  that  are  valid  for  evaluating) 
\attack  accuracy  / 

PK  a probability  that  a transiting  submarine  is  destroyed, 

given  that  an  accurate  attack  is  made 

_K_  _ Number  of  transitors  killed  by  the  SSK 
A2  /Number  of  accurately  placed  attacks  by\ 

'the  SSK  against  the  transitor  < 

LOWER  LEVEL  EVALUATION: 

PA2  s probability  of  accurate  attack 

(pF  pAp  + QF  V PS 

where 

Pp  = probability  of  an  accurate  fire  control  solution  at 
time  of  fire,  given  that  an  attack  is  made 

«F  * 1 - PF 

pAP  = probability  of  an  accurate  placement,  given  satis- 
factory torpedo  performance  through  the  placement 
point  and  an  accurate  fire  control  solution  at  TOF 

PAp  = probability  of  an  accurate  placement,  given  satis- 
factory torpedo  performance  through  the  placement 
point  and  an  inaccurate  fire  control  solution  at  TOF 
a probability  of  satisfactory  shipboard  system  perfor- 
mance, given  that  an  attack  is  made 
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ASSUMPTIONS: 


(1)  A valid  detection  opportunity  Is  defined  as  a transiting 
enemy  submarine  entering  the  SSK  patrol  area.  Accord- 
ingly, when  all  transltors  pass  through  the  SSK  patrol 
area,  all  transits  are  detection  opportunities. 

(2)  A detection  is  defined  as  occurring  when  the  SSK  gains 
contact  on  the  transltor. 

(3)  Correct  classification  of  the  transltor  occurs  when 
the  SSK  correctly  Identifies  a sonar  contact  as  an 
enemy  submarine. 

(4)  An  attack  Is  defined  as  occurring  with  the  simulated 
or  actual  launch  of  one  of  more  weapons. 

(5)  An  accurate  attack  or  accurately  placed  attack  for 
actual  torpedo  firings  is  defined  as  one  during  which 
the  target  passes  through  the  acquisition  cone  of  the 
torpedo  as  It  approaches  the  target;  for  simulated 
firings,  one  for  which  a torpedo  would  have  reached 
theoretical  acquisition  range  by  following  the  pro- 
grammed run,  Including  wire  guidance  commands. 

(6)  A kill  is  defined  as  occurring  when  an  attack  would 
have  resulted  In  an  actual  kill  had  a warshot  weapon 
been  used. 

DATA  REQUIREMENTS  SUMMARY; 

DATA  ITEM  DATA  SOURCE 

D Determined  by  comparing  the  bearing  of  sonar 

contacts  contained  In  the  SSK* s Sonar  Contact 
Logs  and  the  Commanding  Officer's  Narrative 
with  the  bearing  of  the  transltor  on  the 
reconstructed  track. 

C Obtained  from  analysis  of  the  Sonar  Contact 

Log  and/or  Commanding  Officer's  Narrative. 

A1  Obtained  from  the  Commanding  Officer's 

Narrative  and/or  the  submitted  attack  records, 

A2,  K Determined  during  reconstruction. 
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(NOTE:  In  this  development,  all  of  the  data  may  come  from  a 
set  of  transits  such  that  D In  the  numerator  of  PQ 
Is  the  same  as  the  D In  the  denominator  of  Pg,  etc. 
However,  this  Is  not  a necessary  condition  for  use 
of  this  model;  l.e.,  the  data  sample  used  for  one 
phase  can  be  different  from  the  data  sample  used  In 
the  succeeding  phase.  An  example  of  how  this  Is 
likely  to  occur  Is  as  follows:  An  exercise  transltor 
Is  detected,  classified,  and  tracked.  During  the  SSK's 
approach  the  exercise  transltor  experiences  a casualty 
and  goes  out  of  action  for  several  hours.  The  Inter- 
action Is  valid  for  detection  and  classification,  but 
Invalid  for  approach  and  attack.  Hence,  In  this  case, 
the  C In  the  denominator  of  P^  Is  one  less  than  the  C 
In  the  numerator  of  Pg.) 

REFERENCE:  "Submarine  Analysis  Notebook" 

Commander,  Submarine  Development  Group  Two 
Sept.  1973,  CONF. 


SI -2  (Submarine  In  Area  Search  Mission) 

DESCRIPTION:  Ownshlp  Is  assigned  the  task  of  seeking  out  and  destroying 
an  enemy  submarine  In  a designated  ocean  area,  given  the  target  location 
Is  unknown.  There  Is  a considerable  range  of  tactical  options  available 
to  the  searcher,  e.g.,  choice  of  search  pattern,  mode  of  sonar  operation. 
The  searcher  may  sweep  through  the  search  area  overtly,  l.e.,  radiating 
sufficient  noise  to  lure  a target  Into  an  attack  position.  Alternately, 
the  searcher  may  use  a covert  search,  attempting  to  detect  and  kill  a 
target  while  remaining  undetected.  This  latter  type  of  search  Is  more 
prevalent  at  present. 

(1)  SPECIFIC  OBJECTIVE:  Detect  and  kill  the  target  submarine. 


MOE  ■ Area  Search  Effectiveness  (ASE) 

■ Probability  that  own  ship  will  detect  and  kill  a target 
submarine  at  or  before  time  t,  given  that  a detection 
opportunity  begins  at  time  0 and  continues  without 
Interruption  through  time  t 

■ V1*  PC  PA1  PA2  PK 
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*** 


where 


ps(t) 


probability  that  a target  Is  detected  and  Is  killed 
at  or  before  time  t,  given  that  a target  Is  killed 


probability  that  own  ship  correctly  classifies  the 
target  without  being  successfully  counterattacked 
between  time  of  detection  and  classification, 
given  a detection 

C a Number  of  correct  classifications  by  own  ship 
Ef  /Number  of  detections  by  own  ship  tnat  are\ 

\ valid  opportunities  for  classification  > 

probability  that  own  ship  makes  an  attack  without 

being  successfully  counterattacked  between  time 

of  classification  and  attack,  given  correct 

classification 

A1  a Number  of  attacks  made  by  own  ship 
T /Number  of  correct  classifications  by 
(own  ship  that  are  valid  approach 
\opportun1ties 

probability  that  own  ship  conducts  an  accurate 

attack  (l.e. , accurate  placement  of  the  weapon 

as  evaluated  when  the  weapon  approaches  the 

target  and  not  at  time  of  fire)  against  a target 

submarine  without  being  successfully  counterattacked 

between  the  time  of  attack  and  the  time  the  launched 

weapon  no  longer  requires  control  by  the  firing  ship 

for  successful  culmination  of  the  attack,  given 

that  an  attack  Is  made 

A2  . Number  of  accurately  placed  attacks  bv  own  ship 
ST  /Number  of  attacks  made  by  own  strip  tnat  are\ 

\ valid  for  evaluating  attack  accuracy  / 

probability  of  a kill,  given  that  an  accurate  attack 

is  made 

K a Number  of  kills  by  own  ship 

"S3"  /Number  of  accurately  placed  attacks) 
v by  own  ship  ' 


Hi  . i e(-t/t)  if 

n n e 1"1 


(S4/t) 


ev  1 
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nt 


time  for  which  ASE  Is  being  estimated 
number  of  complete  runs 
exercise  mean  tlme-to-detectlon 

Sum  of  search  times 

Total  number  of  detections 

length  of  the  time  Interval  between  detection  and 

kill  on  a complete  1th  run;  ordered  such  that 

S1-l*Si-S1+l 

number  of  complete  runs  on  which  the  Interval 

between  detection  and  kill  was  less  than  t,  l.e., 

n*  *s  such  that  S„  £ t<S„  +1 
t n*  n*. 


ASSUMPTIONS; 

(1)  A detection  opportunity  exists  whenever  both  the 
searcher  and  target  are  In  the  designated  search 
area. 

(2)  A detection  Is  defined  as  occurring  when  the  searcher 
gains  contact  on  a target. 

(3)  Correct  classification  of  the  target  occurs  when  the 
searcher  correctly  Identifies  a sonar  contact  as  an 
enemy  submarine. 

(4)  An  attack  Is  defined  as  occurring  with  the  simulated 
or  actual  launch  of  one  or  more  weapons. 

(5)  An  accurate  attack  or  accurately  placed  attack  for 
actual  torpedo  firings  Is  defined  as  one  during  which 
the  target  passes  through  the  acquisition  cone  of  the 
torpedo  as  It  approaches  the  target;  for  simulated 
firings,  one  for  which  a torpedo  would  have  reached 
theoretical  acquisition  range  by  following  the  pro- 
grammed run,  Including  wire  guidance  commands. 

(6)  A kill  Is  defined  as  occurring  when  an  attack  would 
have  resulted  In  an  actual  kill  had  a warshot  weapon 
been  used. 
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REQUIREMENTS  SUMMARY: 

DATA  ITEM DATA  SOURCE 

D Determined  by  comparing  the  bearing  of  sonar 

contacts  contained  In  the  Sonar  Contact  Logs 
and  the  Commanding  Officer's  Narrative  with 
the  bearing  of  the  target  on  the  reconstructed 
track. 

C Obtained  from  analysis  of  the  Sonar  Contact 

Log  and/or  Commanding  Officer's  Narrative. 

A1  Obtained  from  the  Commanding  Officer's 

Narrative  and/or  the  submitted  attack  records. 

A2,  K Determined  during  reconstruction. 

t.  Determined  during  reconstruction.  If  detec- 

• £h 

tlon  Is  gained  on  the  1 run  before  the 
searcher  enters  the  search  area,  then  t^  * 0. 

S.|  Determined  during  reconstruction  as  the  inter- 

val between  detection  and  the  predicted  or 
actual  Impact  of  a simulated  weapon  or  real 
weapon,  respectively. 

(NOTE:  In  this  development,  all  of  the  data  may  come  from  a 

single  exercise  such  that  C In  the  numerator  of  P^ 

Is  the  same  as  the  C In  the  denominator  of  P^,  etc. 
However,  this  Is  not  a necessary  condition  for  use 
of  this  model;  l.e.,  the  data  sample  used  for  one 
phase  can  be  different  from  the  data  sample  used  In 
the  succeeding  phase.  An  example  of  how  this  Is 
likely  to  occur  Is  as  follows:  A target  Is  detected, 
classified,  and  tracked.  During  own  ship's  approach 
the  target  experiences  a casualty  and  goes  out  of 
action  for  several  hours.  The  interaction  Is  valid 
for  detection  and  classification,  but  Invalid  for 
approach  and  attack.  Hence,  In  this  case,  the  C In 
the  denominator  of  P^  is  one  less  than  the  C In  the 
numerator  of  Pc.  However,  some  complete  runs  are 
needed  In  order  to  determine  the  times  S^„) 
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REFERENCE: 


"Submarine  Analysis  Notebook" 

Commander,  Submarine  Development  Group  Two 
Sept.  1973,  CONF. 


SI "3  (Submarine  In  Surveillance  Aided  Intercept  Mission) 

DESCRIPTION:  A search  area  of  sufficient  magnitude  Is  such  that  own  ship, 
using  Its  own  detection  capability,  would  have  difficulty  in  detecting  an 
on-station  or  transiting  target  In  a timely  manner.  Intelligence  about 
the  motion  of  the  target,  gained  by  an  outside  surveillance  system,  Is 
transmitted  to  the  submarine,  which  then  attempts  to  intercept  (close, 
detect,  and  classify)  the  target.  Intercept  Is  considered  successful  If 
the  submarine  attains  a position  relative  to  the  target  which  Is  suitable  for 
Its  ultimate  objective  (kill,  general  or  close  surveillance,  etc.).  The 
success  of  own  ship  depends  directly  on  the  effectiveness  of  target  localiza- 
tion, and  the  command  and  control  efficiency  of  the  surveillance  system. 

(1)  SPECIFIC  OBJECTIVE:  Close,  detect  and  classify  a submarine  target 
with  the  aid  of  a surveillance  system. 

MOE  ■ Surveillance  Aided  Intercept  Effectiveness  (SAIEl 
■ Probability  that  the  submarine  will  covertly  detect, 
classify  and  close  a target  detected  by  a surveillance 
system,  and  designated  for  Intercept,  utilizing 
localization  Information  from  the  surveillance 
system  In  real  time 

“ PL  I PT  ^PR‘  PP’  PD1  + PD2**  + W|  PC'PA 


where 

P|_  ■ probability  that  the  surveillance  system  localizes  the 
target  at  least  once,  given  an  opportunity 


PT  ■ probability  that  the  current  surveillance  localization 
Is  effective,  given  that  at  least  one  localization 
occurs.  (Effective  localization  Is  not  defined  In  an 
absolute  sense*,  rather,  the  analyst  evaluates  each 
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D1 


D2 


D3 


run.  Localization  Is  considered  to  be  non-effective 
If  it  Is  evaluated  as  Insufficient  to  effect  an  Inter- 
cept by  the  submarine.  ) 

nt 

K 

probability  that  own  ship  utilizes  the  current 
localization,  given  that  an  effective  localization 
was  obtained 

\ 

"t 

probability  that  own  ship  attains  search  position, 
given  that  he  utilized  the  current  data 

np  + %i 


¥ 

probability  that  own  ship  detects  the  target,  given 
that  he  attained  search  position 

* ”02 

"p  + N01 

probability  that  own  ship  detects  the  target, 
given  that  he  did  not  utilize  the  current 
effective  localization 

NQ3 
NT  " 

probability  that  own  ship  detects  the  target, 
given  that  the  localization  Is  non-effective 

^04 


probability  that  own  ship  correctly  classifies  the 
target  without  being  successfully  counterattacked 
between  time  of  detection  and  classification,  given 
a detection 

NC 


1 


D1 


^03  + ^D4 
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P(S  ■ probability  that  own  ship  makes  an  undetected 
approach  to  a suitable  position  for  kill  or  for 
Initiating  surveillance,  given  that  a correct 
classification  exists 


Nq  ■ number  of  opportunities  (exercise  runs) 

■ number  of  exercise  runs  on  which  at  least  one  sur- 
veillance localization  occurs 
Nj  ■ number  of  exercise  runs  on  which  the  current  local- 
ization Is  effective  (the  target's  position  Is  within 
own  ship's  search  area)  when  the  target  is  detected, 
or  own  ship  enters  the  search  area,  or  the  target 
reaches  CPA,  and  own  ship  Is  not  In  the  search  area 
NR  ■ the  number  of  exercise  runs  on  which  own  ship  had 

correctly  received  and  utilized  the  current  effective 
localization 

Np  ■ the  number  of  exercise  runs  on  which  own  ship  com- 
menced a search  of  the  area  based  on  effective 
localization  prior  to  detection  of  the  target 
N01  ■ the  number  of  exercise  runs  on  which  own  ship  detects 
the  target  while  enroute  to  a search  area  based  on 
effective  localization,  and  the  target  is  contained 
in  the  search  area 

Nq2  * the  number  of  exercise  runs  where  own  ship  detects 
the  target  within  the  search  area  while  conducting  a 
search  of  the  area 

Njjs  ■ the  number  of  exercise  runs  on  which  own  ship  detected 
the  target  while  acting  on  localization  data  that  Is 
either  outdated  (more  recent  effective  localization 
has  occurred,  but  has  not  been  received)  or  that  has 
been  garbled  In  transmission,  or  has  been  erroneously 
evaluated 
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Nq4  « the  number  of  exercise  runs  on  which  own  ship  detected 
the  target  while  acting  on  localization  data  that  was 
non-effective 

■ the  number  of  exercise  runs  on  which  own  ship  correctly 
classifies  the  target 

■ the  number  of  exercise  runs  on  which  own  ship  completes 
an  undetected  approach  to  a position  relative  to  the 
target  from  which  he  may  carry  out  his  assigned 
combat  role 

ASSUMPTIONS: 

(1)  An  exercise  run  Is  that  period  of  time  during  which  the 
target  proceeds  along  a designated  track  through  an 
assigned  patrol  area  at  such  a speed  or  In  such  a 
condition  that  detection  by  the  surveillance  system  Is 
likely. 

(2)  A surveillance  localization  Is  said  to  occur  If  and  when 
the  assisting  surveillance  system  supplies  the  Submarine 
Operational  Control  Authority  (OPCON)  with  an  estimate 
of  target  position,  heading,  speed,  and  a corre- 
sponding measure  of  confidence  In  each,  at  any 

time  during  an  exercise  run. 

(3)  Own  ship's  assigned  search  region  Is  generally  a 
square  area,  centered  on  the  reported  target's 
position,  oriented  such  that  one  pair  of  sides  are 
parallel  to  the  course  vector,  and  which  moves  with 
time  along  the  target's  reported  PIM  vector.  The 
search  region  Is  reset  with  each  updated  localization 
reported  by  the  surveillance  system,  and  the  DR 
restarted  from  the  new  localization  position  and  along 
the  new  PIM  received. 

(4)  The  target  Is  said  to  be  contained  within  the  search 
region;  or,  conversely,  the  surveillance  localization 
Is  said  to  be  effective  If  one  of  the  following  con- 
ditions exists: 
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(4. a)  If  own  ship  detects  the  target  when  the  target 
Is  within  the  search  region. 

(4.b)  If  own  ship  attains  (defined  below)  the  search 
region  and  the  target  Is  within  the  search 
region. 

(4.c)  If  own  ship  neither  detects,  nor  attains,  and 
the  target  Is  within  the  search  region  at  the 
time  of  CPA. 

(5)  An  effective  localization  Is  utilized  by  own  ship  If 
the  localization  Information  has  been: 

(5. a)  Received  without  garbles,  plotted  correctly, 
and  Is  the  basis  for  subsequent  action  by  own 
ship. 

(5.b)  Received  garbled,  recognized  as  incorrect, 

proper  correction  applied,  plotted  correctly, 
and  used  as  above. 

(6)  Own  ship  Is  said  to  attain  a desired  position  within 
the  search  region  If  either  of  the  following  conditions 
exists: 

(6. a)  Own  ship  enters  the  search  region  prior  to 
detecting  the  target. 

(6.b)  Own  ship  aetects  the  target  while  enroute  to 
the  search  region,  and  the  target  Is  contained 
within  the  search  region. 

REFERENCE:  "Submarine  Analysis  Notebook" 

Commander,  Submarine  Development  Group  Two 
Sept.  1973,  CONF. 
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TABLE  B-2  Operational  Test  & Evaluation 
MOE  Data  Base  (Continued) 


Area;  Surface  Ships  (SS) 

COPE  ITEM 

551  Destroyer 

SSI -1  (Destroyer  In  Close-In  Screening 

Mission) 

SSI -2  (Destroyer  In  Barrier/Search  Attack 

(SAU)  Mission) 

SSI -3  (Destroyer  In  Passive  Barrier/Cold  War 

Submarine  Hold-Down  Mission) 

SSI -4  (Destroyer  Using  Jezebel ) 

552  Amphibious  Assault  Ship  (LPH-2,  Sea  Control 
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SURFACE  SHIPS  (SS) 


SSI  - Destroyer 

SSI-1  (Destroyer  In  Close-In  Screening  Mission) 

DESCRIPTION:  A close-in  destroyer  screen  attempts  to  prevent  an  enemy 
submarine  from  penetrating  the  screen  and  gaining  a position  to  launch 
a torpedo  attack  on  a protected  high  value  unit  (HVU). 

(1)  SPECIFIC  OBJECTIVE:  Prevent  a single  submarine  penetrator  from 

attacking  a protected  merchant  convoy  or  task  force. 


MOE  " Destroyer  Screen  Effectiveness 

■ Probability  that  a single  submarine  is  prevented  from  pene- 
trating a close-in  destroyer  screen  and  gaining  position  to 
launch  a torpedo  attack  on  a high  value  unit  (HVU) 

* PD/0  PE/D  PAT/E  PH/AT  PK/H 


where 


PD/0  * probability  of  detection  given  an  opportunity 

D /Number  of  valid  detections  by  the\ 

a _1_  x Vdestroyer  screen ) 

~C~  /Number  of  penetrations  attempted,  l.e., 

'number  of  valid  screen  detection  opportunities 


PAT/E” 


probability  of  engagement  given  detection 

r /Number  of  valid  submarine  detections  that  arei 

C1  m \ engaged  by  the  destroyer  screen  > 

ST  /Number  of  valid  screen  detections  that  are\ 
walld  opportunities  for  engagement  ' 

probability  of  attack  given  engagement 

* /Number  of  "yes"  decisions  for  a screen  ’ 

M1  , 'destroyer  to  attack  the  penetrating  submarine/ 
E7  /Number  of  screen  engagements  that  are  va)ld\ 

( attack  decision  opportunities  for  the  ) 
Vdestroyer  screen  / 


PH/AT*  Probab^1ty  given  attack 
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H /Number  of  valid  "yes"  decisions  to  attack 

. nl  a 'that  result  In  weapon  hit ; 

S7  /Number  of  "yes"  decisions  to  attack  that\ 
c 'are  valid  opportunities  for  weapon  hit  ' 

PK/H  * probability  of  kill  given  a hit 

B JL  « (Number  of  kills) 

H«  /Number  of  valid  attacks  which' 

Iresult  In  weapon  hit  ' 

LOWER  LEVEL  EVALUATION 

(a)  P^p  * probability  of  engagement  given  detection 

* O - pLC)  pE/tr 


wharc 


probability  that  the  destroyer  screen  irretrievably 
loses  contact  on  the  penetrating  submarine 


f Number  of  submarines  that  successfully  penetrate\ 
because  the  destroyer  screen  loses  contact  ) 
irretrlevahl v / 


MrretrleyabJ 
/Number  of  de 


ejections  that  are  valid  engagement' 
es  for  the  destrover  screen  / 


'opportunities  for  the  destroyer  screen 


PE/OT  * probability  that  a screen  destroyer  maneuvers  to  a 
' position  such  that  an  attack  decision  can  be  made, 
given  that  an  irretrievable  lost  contact  Is  not  the 
cause  of  submarine  success 

(Number  of  times  a screen  destroyer  \ 
successfully  gains  position  to  attack] 

a penetrator / 

117  * /Number  of  vaUd  engagement  opportunities 
(upon  which  contact  Is  not  Irretrievably 
\lost 


(b)  ph/at  " Probability  of  hit  given  attack 

* PTL/AT  PAPT/TL  PH/APT  + PAL/AT  PAPA/AL  PH/APA 


+ P0ATL/AT  PAPATD/DATL  PH/APATD 


+ PDTL/AT  PAPTD/DTL  PH/APTD 
* PDAL/AT  PAPA0/DAL  PH/APA0 
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where 


PT,  /AT  ■ probability  of  single  Surface  Vessel  Torpedo  Tube 
L/M  (SVTT)  launch,  given  an  attack 

/T,  x /Number  of  destroyer  screen  attacks  In  which 

B _ L;1  a \a  single  SVTT  launch  Is  made 

A2  /Total  number  of  destroyer  screen  attacks\ 
c (that  are  valid  opportunities  for  any  ASW) 
\weapon  launch  / 


P«dt/ti  * probability  of  accurate  placement,  given  single 
aki/il  syrr  ]aunch 


(APT)  /Number  of  single  SVTT  launches  which  result 

B _ ;1  B \1n  accurate  placement  of  weapon 

/j,  x /Number  of  single  SVTT  launches  which  are 
' L'2  (valid  opportunities  for  accurate  weapon 
\placement 

Pm/.bt  * probability  of  hit,  given  accurate  placement  of  single 
n/Mn  SVTT  in  a single  SVTT  launch 


/Number  of  accurate  placements,  In  single\ 
\SVTT  launches,  that  result  In  weapon  hit' 

(Number  of  accurate  placements,  in  single  ' 
SVTT  launches,  that  are  valid  opportunities 
for  weapon  hit 


PAL/AT 


probability  of  single  ASROC  launch,  given  an  attack 


/Number  of  destroyer  screen  attacks  in  which  a' 
vsingle  ASROC  is  launched . 

(Total  number  of  destroyer  screen  attacks  that' 
are  valid  opportunities  for  any  ASW  weapon 
launch  / 


PAPA/AL  * Potability  accurate  placement,  given  single  ASROC 
launch 

(APA)  /Number  of  single  ASROC  launches  which  result 

, ' ;1  B \1n  accurate  placement  of  weapon 

(AL).  /Number  of  single  ASROC  launches  which  are\ 
(valid  opportunities  for  accurate  weapon  ) 
\placement  / 
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PU/ada  * probability  of  hit,  olven  accurate  placement  of  single 
ASROC  In  a single  ASROC  launch 

/Number  of  accurate  placements,  in  single  \ 

* M B ‘ASROC  launches,  thatresuj_t  In  weapon  hit' 

( A PA ) 2 /Number  of  single  ASRbC  accurate  placements  ,\ 

( In  single  ASROC  launches,  that  are  valid  ) 
\opportunities  for  weapon  hit  / 

Pqtl/at  * Probab1 1 1 ty  of  dual  SVTT  launch,  given  an  attack 

3 3 Number  of  dual  launched  SVTT  attacks 

A»  /Total  number  of  destroyer  screen  attacks\ 

I that  are  valid  opportunities  for  any  ASW  I 
\weapon  launch  / 

P ApTn /dti  * probability  of  accurate  placement  of  at  least 

Hr  U/U  L one  SVTTt  g1ven  dual  SVTT  launch 

(APTDl  /Number  of  dual  SVTT  launches  which  result  1n\ 
a ' « \accurate  placement  of  at  least  one  weapon  / 
(&Yl)2  /Number  of  dual  SVTT  launches  which  are  valid\ 
lopportunltles  for  accurate  placement  / 

Pu/.prn  3 probability  of  one  hit,  given  accurate  placement  of  at 
"/rtKIU  least  one  of  two  SVTT's  In  a dual  SVTT  launch 


(Number  of  times  that  accurate  placement  of  \ 
at  least  one  weapon,  in  a dual  SVTT  launch,) 

_ results  In  a weapon  hit / 

(APTD)2  ""/Number  of  t-lmes  that  accurate  placement  of\ 
fat  least  one  weapon,  In  a dual  SVTT  launch,) 
\1s  a valid  opportunity  for  a weapon  hit  / 


PDAL/AT 


probability  of  dual  ASROC  launch,  given  an  attack 


Number  of  dual  launched  ASROC  attacks 
Total  number  of  destroyer  screen  attacks' 
that  are  valid  opportunities  for  any 
,ASW  weapon  launch  , 


PADAn/nai  3 probability  of  accurate  placement  of  at  least  one 
hkhu/uhl  Qf  the  asroc.Sj  g1ven  dual  ASR0C  launch 


(APAO ) 1 

■ WJ7 


Number  of  dual  ASROC  launches  which  result  in 
accurate  placement  of  at  least  one  weapon 
Number  of  dual  ASROC  launches  which  are  valid 
opportunities  for  accurate  placement 
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Pu/A0An  ■ probability  of  one  hit.  given  accurate  placement  of  at 
n/ArMu  ieast  one  0f  two  ASROC's  In  a dual  ASROC  launch 


(Number  of  times  that  accurate  placement  of  \ 
at  least  one  weapon,  In  a dual  ASROC  launch,] 

* results  in  a weapon  hit / 

(APA0)2  = /Number  of  times  that  accurate  placement  of  at' 
(least  one  weapon.  In  a dual  ASROC  launch,  is 
\a  valid  opportunity  for  a weapon  hit  ; 


PDATL/AT 


probability  of  dual  ASROC/SVTT  launch,  given  an  attack 

^^1  r Number  of  dual  ASROC/SVTT  launch  attacks 
T*  /Total  number  of  destroyer  screen  attacks 
(that  are  valid  opportunities  for  any  ASW 
\weapon  launch 


PflPATn/nATi  * probability  of  accurate  placement  of  at  least  one  of 
mkhiu/umil  the  twQ  wfiapons  (ASROC/SVH)  given  dual  ASROC/SVTT 

launch 

/Number  of  dual  ASROC/SVTT  launches  which’ 
/« DATn\  ( result  In  accurate  placement  of  at  least 

, , None  weapon . 

(DAtL)2  /Number  of  dual  ASROC/SVTT  launches  which 
(are  valid  ODportunities  for  accurate 
\weapon  launch  > 


pn/APATn  * probability  of  one  hit,  given  accurate  placement  of 
' at  least  one  of  the  two  weapons  in  a dual  ASROC/SVTT 

launch 


(Number  of  times  that  accurate  placement  \ 
of  at  least  one  weapon,  in  a dual  ASROC/) 
- _ SVTT  launch,  results  In  a weapon  hit  / 

’ (AMYD)2  " /Number  of  times  that  accurate  placement \ 
c / of  at  least  one  weapon,  in  a dual  ASROC/J 
l SVTT  launch,  is  a valid  opportunity  for/ 
\a  weapon  hit  / 


ASSUMPTIONS: 

(1)A  submarine  must  penetrate  the  destroyer  screen  in  order  to  attack 
an  HVU.  Submarine  attacks  on  HVU  from  outside  the  destroyer  screen 
(l.e.,  a cruise  missile  attack)  are  not  considered.  This  assumption 
Is  made  because  In  the  SHAREM  exercises,  which  are  the  major  source 
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of  data  for  estimating  the  MOE,  the  submarine  Is  required  to  pene- 
trate the  destroyer  screen  In  order  to  gain  an  attack  position  on 
an  HVU.  The  attack  position  Is  defined  In  terms  of  the  range  to 
the  nearest  HVU. 

(2)  The  attacking  submarine  is  said  to  have  successfully  penetrated  the 
destroyer  screen  when  (1)  It  has  closed  the  HVU  to  an  attack  posi- 
tion or  (2)  It  has  reached  a position  Inside  the  screen  such  that 
an  HVU  lies  along  the  bearing  line  from  an  attacking  destroyer  to 
the  penetrating  submarine. 

(3)  Data  from  astern  penetrations  should  not  be  aggregated  with  data 
from  ahead  penetrations  since  radiated  noise  and  perturbed  water 
conditions  astern  the  screened  body  make  astern  penetrations  non- 
equivalent to  ahead  penetrations  with  similar  relative  speeds. 

(4)  Submarine  evasion  of  the  destroyer  screen  is  not  considered  ( 1 . e . , 
the  submarine  either  successfully  penetrates  or  Is  killed).  Neither 
the  model  nor  the  present  SHAREM  exercises  are  designed  to  evaluate 
the  effect  of  forestalling  a submarine  penetration.  To  model  the 
effectiveness  of  forestalling  would  require  a quantitative  measure 
of  screet:  effectiveness  as  a function  of  time.  The  present  model 
may  serve  as  a building  block  for  such  a more  general,  all  inclu- 
sive model.  If  future  SHAREM  exercises  include  situations  where 

the  penetrating  submarine  evades,  such  that  It  Is  no  longer  con- 
sidered a penetration  threat,  a term  could  be  added  to  the  model 
presented  herein  to  account  for  this.  Evasion,  so  defined,  is 
mutually  exclusive  of  both  the  submarine  being  killed  and  the  sub- 
marine successfully  penetrating  the  screen.  Evasion  may  occur, 
for  example,  due  to  a HVU  maneuver  based  upon  screen  detection. 

(5)  Details  (e.g.,  reattacks)  of  a destroyer/submarine  dogfight  are  not 
considered.  Submarine  attacks  on  destroyers  are  not  considered. 

In  the  present  SHAREM  scenario,  the  above  occurrences  are  rare. 
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If  any  of  the  above  did  occur  during  a penetration  run,  however, 
the  success  or  failure  of  the  destroyer  screen  In  attaining  a posi- 
tion to  attack  (and  deciding  to  attack)  the  penetrating  submarine 
should  be  Included  in  the  data  base  for  evaluating  destroyer  screen 
effectiveness. 

(6)  If  the  destroyer  weapon  Is  not  accurately  placed,  It  Is  assumed 
that  the  submarine  Is  not  hit.  A weapon  Is  said  to  be  accurately 
placed  If  the  target  falls  within  the  nominal  acoustic  acquisition 
cone  of  the  enabled  weapon. 

(7)  If  a submarine  is  Initially  detected  and  contact  Is  lost  and  later 
regained  by  the  same  screen  destroyer  or  by  another  screen  destroyer, 
that  submarine  is  considered  to  be  only  one  screen  detection  ( i . e . , 
there  can  be  no  more  than  one  screen  detection  per  penetration  attempt). 

(8)  The  destroyer  screen  Is  Initially  semi -alerted,  (i.e.,  destroyer 
screen  knows  the  submarine  Is  In  the  area  but  does  not  have  a 
bearing  and/or  range  estimate.) 

(9)  The  probability  of  screen  destroyers  prosecuting  a non-submarine 
detection  (I.e.,  a false  contact)  Is  not  explicitly  considered 
In  this  evaluative  model;  rather,  false  contacts  are  considered 

in  destroyer  performance  measures  addressed  separately.  It  should 
be  realized,  however,  that  prosecuting  false  contacts  could  have  a 
degrading  effect  on  destroyer  screen  effectiveness.  It  may,  for 
Instance,  be  the  cause  of  a penetrating  submarine  not  being 
detected.  As  such,  Its  degrading  effect  Is  Implicitly  reflected 
In  this  measure. 

(10)  The  probability  of  the  destroyer  screen  correctly  classifying  a 
valid  submarine  detection  Is  Implicitly  included  In  this  model 
(I.e.,  detecting  a valid  submarine  means  detecting  and  classi- 
fying It). 

(11)  Only  one  destroyer  will  attempt  to  engage  the  submarine  given  that 
the  penetrating  submarine  is  detected  by  the  destroyer  screen 
(I.e.,  only  one-on-one  encounters  are  considered). 
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(12)  If  a submarine  Is  Initially  detected  and  contact  Is  lost  and  later 
regained  by  the  same  screen  destroyer  or  by  another  screen  destroyer, 
that  submarine  is  considered  to  be  only  one  valid  detection,  l.e., 
there  can  be  only  one  screen  detection  per  penetration  attempt. 

(13)  If  a detection  Is  made  and  contact  Is  lost  and  never  regained  due 
to  evasion  or  confusion  on  the  part  of  the  submarine  such  that 

it  falls  to  close  the  destroyer  screen  and  pass  between  screen 
destroyers,  that  submarine  Is  considered  to  have  been  neither  a 
valid  detection  opportunity  nor  a valid  detection. 

(14)  A screen  detection  Is  a valid  opportunity  for  engagement  If  the 
destroyer  Is  not  artificially  prevented  from  attaining  an  attack 
position  relative  to  the  submarine  - for  example,  a run  termina- 
tion prior  to  engagement. 

(15)  A decision  to  attack  is  made  when  the  firing  order  to  launch  a 
weapon  is  given;  however,  for  each  engagement  only  one  attack 
decision  Is  counted. 

(16)  The  measure  of  effectiveness  is  regarded  as  an  estimate  of  the 
probability  of  kill  given  an  opportunity,  since  it  is  not  necessarily 
equal  to  the  number  of  kills  divided  by  the  number  of  opportunities. 
The  reason  for  this  Is  that  runs  are  sometimes  truncated,  that  Is, 

a success  In  one  phase  of  an  encounter  may  not  be  a valid  opportunity 
for  the  next  phase  due  to  the  exercise  run  being  prematurely 
terminated  by  the  OTC  of  the  exercise. 

(17)  If  contact  is  regained  by  the  destroyer  screen  prior  to  submarine 
penetration  of  the  screen,  the  destroyer  screen  Is  not  considered 
to  have  Irretrievably  lost  contact. 

(18)  A weapon  is  considered  to  be  accurately  placed  if  the  target 
falls  within  the  nominal  acoustic  acquisition  cone  of  the 
enabled  weapon. 
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(19)  If  a dual  launch  Is  attempted  but  due  to  fire  control,  weapon, 
or  personnel  failure  only  one  weapon  enters  the  water,  then 

that  launch  Is  treated  as  a single  launch.  If  due  to  any  failure 
no  weapons  enter  the  water,  then  that  run  Is  assessed  as  a failure 
to  launch. 

(20)  The  expanded  probability  of  hit  given  attack  allows  for  only  one 
launch  tactic  per  attack  and  only  one  hit  per  attack. 
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DATA  REQUIREMENTS  SUMMARY: 


^^DATA  SOURCE 

WEAPONS  TESTS, 

DATA  ITEM 

DETECTION 

EXERCISES^ 

ATTACK 

EXERCISES*3) 

LABORATORY 
TESTS,  ETC. 

°T  °2 


El’  E2 


(TL)r  (AL ) 1 , (DTL)1 
( DAL ) 1 , (DATL), 


(TL)2.  (al)2,  (otl)2 
(DAL)2,  (datl)2 


(APT ) 1 , (APA)r  (APTD)1 
(APAD)  -j  , (APATD)1 


(APT)2,  {APA)2,  (APTD)2 
(APAD)2,  (apato)2 


HT,  HA,  HTD,  HAD,  HATD 


K/H„ 


(NOTES: 

(1)  The  sample  size  of  data  used  to  estimate  each  of  the  conditional 
probabilities  need  not  be  equal.  This  allows  maximum  use  of 
data  from  different  type  exercises  and  also  from  exercise  runs 
which  are  terminated  prior  to  completion  and  thus  valid  for 
estimating  only  some  terms  of  the  model. 

(2)  A detection  exercise  consists  of  repeated  attempts  by  one 
submarine  to. penetrate  a destroyer  screen  that  is  made  up 

of  two  or  more  destroyers  on  patrol  stations  protecting  a single 
ship  high  value  unit  (HVU).  In  this  type  of  exercise,  the  sub- 
marine attempts  to  penetrate  the  screen  to  simulate  a penetra- 
tion attempt  against  a complete  destroyer  screen.  The  penetra- 
ting submarine  neither  attempts  to  evade  the  screen  nor  attacks 
screen  destroyers.  The  submarine  mission  is  to  reach  an  attack 
position  on  a high  value  unit  of  the  screened  body.  Simulated 
submarine  cruise  missile  attacks  from  outside  the  convoy  are  not 
Included  In  these  exercises.  For  the  purpose  of  evaluating 
destroyer  screen  success,  each  non-truncated  exercise  run  results 
In  either  a successful  screen  pe  letratlon  by  the  submarine  or  a 
destroyer  screen  decision  to  attack  a detected  submarine.  The 
actual  exercise  run  terminates  when  either  the  submarine  pene- 
trates the  screen,  the  OTC  terminates  the  run,  or  after  a speci- 
fied period  from  COMEX,  whichever  occurs  first.  Data  for  the 
model  beyond  the  decision  to  attack  the  submarine  In  an  engagement 
Is  obtained  from  SHAREM  attack  exercises  and  other  sources. 

(3)  An  attack  exercise  consists  of  repeated  attempts  by  one  submarine 
to  penetrate  a destroyer's  patrol  area.  The  main  objective  of 
this  type  of  exercise  Is  to  evaluate  destroyer  attack  effective- 
ness. For  the  purpose  of  providing  data  for  the  evaluative  model, 
attack  exercise  runs  proceed  from  the  destroyer  decision  to  attack, 
through  destroyer  weapon  launch,  to  either  automatic  cutoff  (ACO) 
range  ( 1 . e . , weapons  are  not  set  to  hit)  or  weapon  miss.  The 
destroyer  weapons  Include  both  deck  launched  torpedoes  and  ASROC.) 
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REFERENCE:  "Destroysr  Analysis  Notebook" 

COMOESOEVGRU  Technical  Report  15-73 
31  Aug.  1973,  CONF. 

SSI -2  (Destroyer  In  Barrier/Search  Attack  (SAU)  Mission) 

DESCRIPTION:  A coordinated  ASW  group  (Including  destroyers)  attempts 
to  locate,  Intercept,  and  destroy  enemy  submarines  that  are  In  transit 
to  and  from  their  bases  and  operating  areas. 

(1)  SPECIFIC  OBJECTIVE:  Locate,  Intercept  and  destroy  enemy  submarines. 

NOE  ■ Probability  of  destroying  an  eneiiy  submarine  given 
an  opportunity 

* PD/0  PA/D  PK/A 

where 

Pq/0  * probability  of  detecting  an  enemy  submarine, 

/u  given  an  opportunity 

* Number  of  detections 
Number  of  opportunities 

PA/D  * probability  of  accurately  placed  attack,  given 
detection  of  an  enemy  submarine 

u Number  of  accurately  placed  attacks 
Number  of  detections 

PK/«  a probability  of  proper  weapon  functioning,  given  an 
N accurately  placed  attack 

* Number  of  weapons  which  functioned  properly 
Number  of  accurately  placed  attacks 

REFERENCE:  "Destroyer  Analysis  Notebook" 

COMOESOEVGRU  Technical  Report  15-73 
31  August  1973,  CONF. 

SSI -3  (Destroyer  In  Passive  Barrier/Cold  War  Submarine  Hold-Down  Mission) 

DESCRIPTION:  Contact  Is  maintained,  overtly  or  covertly,  with  an  enemy 
submarine  while  It  Is  In  transit  or  on-station  with  the  ability  to  be 
able  to  localize  the  submarine  with  sufficient  speed  and  accuracy  when 
required. 
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(1)  SPECIFIC  OBJECTIVE:  Maintain  contact  sufficiently  so  as  to  be  able 
to  localize  when  required. 

MOE  ■ Probability  of  intercepting  an  unalerted  transiting 
enemy  submarine 

“ PD/0  PAC/D 

where 

pd/o  * probability  of  detecting  an  unalerted  transiting 
u/u  enemy  submarine  using  passive  sonar  (SOSUS  or  air 
dropped  buoys),  given  an  opportunity 

s Number  of  passive  detections 
* Number  of  opportunities 

P... n * probability  of  converting  a passive  sonar  contact 
At'/U  (SOSUS  or  air  dropped  buoys)  to  an  active  sonar 
contact 

m Number  of  active  contacts 
Number  of  passive  detections 

REFERENCE:  "Destroyer  Analysis  Notebook" 

C0MDES0EV6RU  Technical  Report  15-73 
31  August  1973,  CONF. 

SSI -4  (Destroyer  Using  Jezebel) 

DESCRIPTION:  This  ship  utilizes  an  airborne  platform  (in  particular,  the 
drone  anti-submarine  helicopter  (Dash))  to  drop  sonobuoys  and  :o  relay 
the  sonic  Information  to  the  destroyer.  This  concept  provides  the  destroyer 
with  a long  range  detection  and  classification  capability  against  a snorkellng 
diesel  submarine. 

(1)  SPECIFIC  OBJECTIVE:  Evaluate  detection  capability. 

(M0E)1  ■ Detection  success  ratio 

9 Number  of  detections 

Humber  of  detection  opportunities 

(MOEjg  ■ Effective  sonobuoy  detection  range 

ASSUMPTION:  A detection  opportunity  Is  that  period  when  the 
target  submarine  Is  snorkellng. 
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(2)  SPECIFIC  OBJECTIVE:  Evaluate  classification  capability. 

(MOE)^  ■ Classification  success  ratio 

u Number  of  targets  correctly  classified 

/Number  of  opportunities  for  target] 

'classification  > 

(MOEjg  ■ Mean  time  required  to  classify  a target  after 

Initial  contact 

ASSUMPTION:  A target  classification  opportunity  Is  one  where 
received  signature  characteristics  from  one  sonobuoy  matched 
the  known  target  signature  characteristics. 

REFERENCE:  Final  Report  on  Project  F/02S1 

"Conduct  a Fleet  Operational  Investigation  of  the  Destroyer 
Jezebel  Concept" 

3 June  1970,  SECRET 
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SS2  ■ Amphibious  Asc.t  ilt  Ship  (LPH-2) 

DESCRIPTION:  This  Is  a LPH-2  Class  ship  with  AV-8A  fixed  wing  VSTOL 
aircraft  and  SH-3H  ASM  helicopters.  The  ship  operates  helicopters  In 
a continuous  airborne  ASM  mission,  and  VSTOL  In  a react  mode  for  OLI 
(Deck  Launched  Intercept)  or  DLA  (Deck  Launched  Attack)  against  air  or 
surface  threats. 

(1)  SPECIFIC  OBJECTIVE:  Evaluate  single  DLI/DLA  reaction  against  a 

single  threat  In  AAW  and  ASIIRW  missions. 

(HOE)<|  ■ Likelihood  of  Interception 

m Number  of  Intercepts 

Number  of  DLI/DLA  attempts 

(MOE )g  * Average  reaction  time  from  detection  to 
launch 

(M0E)3  ■ Average  reaction  time  from  launch  to 
Intercept 

(2)  SPECIFIC  OBJECTIVE:  Determine  the  capability  to  control  the  laying 
of  sonobuoy  patterns  utilizing  the  SH-3  helicopter. 

(HOE ) i ■ Average  pattern  placement  error 

(MOEJg  ■ Median  pattern  placement  error 

(3)  SPECIFIC  OBJECTIVE:  Determine  system  capability  for  submarine 
localization  and  tracking  using  SH-3  relayed  Jezebel  Information. 

(MOE)^  a Likelihood  of  an  estimated  position  (EP) 

. Nunber  of  estimated  positions  obtained 
/Number  of  opportunities  for  pass1ve\ 

' localization,  given  detection  / 

(MOE ) g ■ Mean  estimated  position  error 

(MOE)j  ■ Median  estimated  position  error 

(4)  SPECIFIC  OBJECTIVE:  Determine  the  system  capability  to  lay  and  main 
tain  a passive  sonobuoy  barrier  at  a specified  range  from  the  ship 
while  maintaining  a fixed  speed-of-advance  (SOA). 
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(HOE) ^ ■ Mean  barrier  kingpin  drop  error 

(MOEjg  ■ Mean  length  error  (nm)  of  achieved  sono- 

buoy  line  from  desired  line,  assuming  king- 
pin drop  Is  accurate 

(MOE)j  ■ Mean  end-to-end  course  error  (deg)  of 

achieved  sonobuoy  line  from  desired  line, 
assuming  kingpin  drop  Is  accurate 

(M0E)4  * Mean  error  (nm)  In  sonobuoy  spacing 

(M0E)s  ■ Mean  deviation  of  sonobuoys  from  desired 
course  (deg) 

(5)  SPECIFIC  OBJECTIVE;  Evaluate  system  response  to  a torpedo  flaming 
datum  or  other  detection  within  a specified  distance  of  a task 
force  main  body. 

(M0E).|  ■ Average  redetection  time,  which  Is  the 
average  of  the  elapsed  time  taken  from 
the  time  of  SH-3H  arrival  at  datum  to  the 
time  of  the  first  confirmed  active  redet- 
ection or  MAD 

(M0E)2  ■ Number  of  magnetic  anomaly  detections 

(M0E)3  ■ Average  redetection  time  to  MAD,  which  Is 
defined  as  the  average  period  of  elapsed 
time  from  time  of  redetection  to  the  time 
of  the  first  MAD 

(M0E)4  * Average  number  of  valid  attacks,  which  Is 
defined  as  the  number  of  attacks  evaluated 
by  the  exercise  submarine  as  "good"  or 
"excellent"  or,  In  the  absence  of  a sub- 
marine evaluation  of  the  attack,  those 
attacks  determined  by  computer  reconstruc- 
tion to  be  within  1000  yds  of  the  submarine 
position 
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(H0£)g  ■ Average  redetection  to  attack  time,  which 
Is  defined  as  the  average  period  of  elapsed 
time  from  the  time  of  redetection  to  the 
time  of  the  first  valid  attack  from  any 
participating  SH-3H 

(MOE)g  * Likelihood  of  kill,  assuming  kill  given  a 

valid  attack  Is  certain 

b Number  of  valid  attacks 

" Total  number  of  attack  opportunities 

(6)  SPECIFIC  OBJECTIVE:  Determine  the  accuracy  and  capability  of  the  system 
to  lay  a sonobuoy  field  using  VSTOL  aircraft. 

(MOE)^  * Average  aircraft  track  error  (deg) 

(MOEjg  * Average  placement  error  of  the  first 
sonobuoy 

(M0E)3  ■ Average  placement  error  of  all  sonobuoys 
dropped 

(MOE)4  ■ Average  placement  error  of  all  sonobuoys 

dropped,  after  removal  of  the  kingpin  error 

(7)  SPECIFIC  OBJECTIVE:  Determine  system  capability  to  control  the  SH-3 
helicopter  to  a specified  sonobuoy  drop  position. 

(MOE)^  » Mean  buoy  drop  error  In  range  (nm) 

(MOE )g  * Mean  buoy  drop  error  In  bearing  (deg) 

REFERENCE:  Second  Partial  Report  on  Project  P/C2 

"Conduct  an  Operational  Appraisal  of  the  Interim  Sea  Control 
Ship" 

14  Aug.  1973,  CONF. 
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TABLE  B-3  Platform,  System  and  Equipment  Index 


AREA 

PLATFORM/SVSTEM/EQUIPMENT  CODE 

Acoustic  countermeasures  ADC9 

Acoustic  Intercept  receiver  ADC8 

Acoustic  nolsemaker  A0C6 

Aircraft  {fixed  wing)  A1 

A2 

A3 

Amphibious  assault  ship  SS2 

Antisubmarine  contact 

analysis  center  D03 

Automatic  permanent 

magnetic  compensator  E0C9 

Avionics  system  DD4 

Bomb 

cluster  01 

television  guided  02 

laser  guided  03 

rocket  assisted  06 

Command  and  control  system  DD2 

Control  wire  detector  EDC4 

Data  communications  set  C5 

Data  relay  system  DD7 

Deception  repeater  EDC16 

Decoy 

electro-acoustic  ADC5 

Infrared  I0D2 

repeater  buoy  EDC19 

Degaussing  system  EDC8 


SUBJECT 

PAGE 

SAWS 

B-30 

AN/WLR-9 

8-29 

NAE  Beacon  Mk  3 Mod  1 

B-27 

F8U-2 

B-3 

S-2G 

B-4 

B-6 

LPH-2  Sea  Control  Ship 

B-166 

ASCAC 

B-48 

B-69 

ANEW 

B-49 

CBU-59/B  APAM,  Mk  15 
Mod  0 SADEYE 

B-120 

Walleye  Mk  1 Mod  0 
Walleye  II  Mk  5 

B-122 

A-6A/RABFAC/Paveway 

B-123 

SUBROC 

B-126 

DATACOURTS 

B-44 

L Mk  3X  Mod  0 (RADRAG) 

B-64 

HICAPCOM 

B-3R 

B-54 

AN/SLQ-1 7 (V ) 

B-78 

NIXIE 

B-26 

B-102 

AN/ULQ-5 

B-82 

B-68 

B-169 


TABLE  B-3  Platform,  System  and  Equipment  Index  (Continued) 


PLATFORH/SYSTEM/EQUIPHENT 

AREA 

CODE 

SUBJECT 

PACE 

Destroyer 

SSI  -1 
SSI -2 

B-152 

B-163 

SSI -3 

B-163 

SSI -4 

8-164 

Direction  finding  system 

EDC13 

AN/SRD-19  (XN-1) 

B-75 

EDC14 

AN/BRO-7 

B-76 

Drone  control  set 

C6 

B-39 

ECM  receiving  antenna 

EDC12 

AS-899/SLR 

B-74 

Electronic  display  system 

DD5  > 

B-51 

Electronic  warfare  system 

EDC11 

AN/ SLQ-27 (XN-1 ) SHORTSTOP 

B-71 

Facilities  control  system 
Fire  control  system 

C7 

CYAN  68  (MPDS/FCS) 

B-40 

bomb 

FC1 

B-85 

gun 

FC2 

Mk  87,  Mk  87  Mod  0 

B-88 

missile 

FC4-1 

AN/SPG-51B 

B-92 

FC4-2 

F-4  AMCS  Aero  1A,  F-8  ABG-4 

B-92 

FC4-3 

B-96 

underwater 

FC3 

Mk  114 

B-90 

Gunpod 

04 

GPU -2/A,  Mk  4 Mod  0 

B-124 

Helicopter 

A4-1 

SH-3A 

B-8 

A4-2 

SH-3H 

B-9 

drone 

A4-3 

DASH 

B-10 

IFF  system 

EDC2 

AN/SLQ-20,  AN/UPX-24 

B-62 

Location  marker 

I0D3 

EX-19,  EX-20 

B-103 

MAD  device 

EDC10 

AN/ASQ-8 

B-70 

Message  processing  and 
distribution  system 

Mine 

09 

DestAjetor  Mk  30  Mod  0 

B-136 

Mine  defense  system 

EDC7 

SHADOWGRAPH 

B-67 

Minehunting  and  surveillance 
system 

07 

SEANETTLE 

B-129 

Minesweeping  equipment 

ADC7 

ROTOVAC  6X,  RCTOVAC  7X 

B-28 

EDC6 

Mk  105  Mod  0,  Mk  104  Mod  1 

B-66 

B-170 


TABLE  B-3  Platform,  System  and  Equipment  Index  (Continued) 


AREA 

PLATFORM/SYSTEM/EQUIPMENT  CODE 

Missile 

air-to-air  Ml 

alr-to-surface  M3 

anti-radiation  M2 

rocket-propelled  ballistic  M5 

surface-to-air  M4-1 

M4-2 

Navigation  system 
aircraft  NG4 

submarine  NG3 

surface  ship  NG1 

Noise  jammer  EDC20 

Radar 

air  search  EDC1-1 

a'*  traffic  control  EDC1-2 

early  warning  EDC1-3 

Radio  frequency  amplifier  EDC18 

Radio  frequency  oscillator  EDC15 

Radio  transmitter  C4 

Report  receiver- transmitter  C3 

Rocket  05 

Sonar 

mine  detectlon/classlflcatlon  ADC1-4 
submarine  ADC1-1 

surface  ship  ADC1-3 

towed  array  ADC 1-2 

Sonobuoy  ADC2 

ADC3 
C2 


SUBJECT 

PAGE 

AIM-9C 

B-105 

AGM-12B  Bull  pup 

B-108 

YAGM-45A  SHRIKE 

B-106 

Mk  1 Mod  0 (TERNE  III) 

B-113 

REDEYE 

B-109 

STANDARD  Missile 

B-110 

AN/APN-1 26 

B-118 

AN/BRN-7  OMEGA  Receiver 

B-117 

OMEGA  Receiver 

B-115 

ALT-27 

B-83 

AN/SPS-49  (XN-1 ) , 

AN/SPS-50  (XN-1),  AN/SPS-52, 
AN/SPS-58 

B-58 

AN/SPN-43 

B-59 

B-60 

AM-4530/ULQ-6A 

B-81 

0-1331  (XN-l)/ULQ-6 

B-77 

AN/WRA-3 

B-37 

B-36 

ZAP 

B-125 

AN/SQQ-14,  AN/SQQ-16 

B-18 

AN/BQR-16,  AN/BQR-19 

B-12 

AN/SQQ-23 

8-14 

AN/BQR-15 

B-13 

CASS 

B-21 

AN/SSQ-20,  AN/SSQ-1 

B-23 

B-35 

Sounder  receiver  system 


TABLE  B-3  Platform,  System  and  Equipment  Index  (Continued) 


PLATFORM/SYSTEH/EOUIPMENT 

AREA 

CODE 

SUBJECT 

PAGE 

Submarine 

Sl-1 

B-139 

SI -2 

B-142 

SI -3 

8-146 

Submarine  classification  and 
tracking  device 

ADC4 

SCAT 

B-25 

TACAN 

NG2 

AN/URN-20 

B-116 

Tactical  data  system 

D01 

NTOS 

B-43 

Target  recognition  set 

EDC3 

AN/ASX-2  (TRISAT) 

B-63 

Teletype  Integrated  display 
system 

DD6 

TIDY 

B-52 

Torpedo 

active/passive 

08-3 

Mk  46  Mod  1 

B-134 

rocket  assisted 

08-2 

ASROC 

B-133 

wl re-guided 

08-1 

Mk  48  Mod  1 

B-131 

UHF  transceiver 

Cl 

AN/WSC-3 

B-33 

Wake  detector 

1001 

B-100 

Warning  receiver 

EDC5 

AN/WLR-8(V)2 

B-65 

EDC17 

B-80 

B-172 


TABLE  B-4  Project  Index 


AREA 


PROJECT 

CODE 

SUBJECT 

__  PAGE 

C/Cl 

08-3 

Mk  46  Mod  1 

B-134 

C/S2 

EDC12 

AS -899/SLR 

B-74 

C/S4 

08-2 

ASROC 

B-133 

C/S5 

001 

NTDS 

B-43 

C/SIO 

EDC16 

B-78 

c/sn 

E0C8 

B-68 

C/SI  2 

ADC1-4 

AN/SQQ-14 

B-18 

C/S17 

06 

SUBROC 

B-126 

C/S18 

A4-3 

DASH 

B-10 

C/SI  9 

CS 

HICAPCOM 

B-38 

C/S21 

NG1 

OMEGA  Receiver 

B-115 

C/S23 

M5 

Mk  1 Mod  0 (TERNE  III) 

B-113 

C/S24 

FC3 

Mk  114 

B-90 

C/S25 

ADC4 

SCAT 

B-25 

C/S34 

EDC1-1 

AN/SPS-49  (XN-1), 
AN/SPS-50  (XN-1) 

B-58 

C/S43 

E0C1S 

0-1331 (XN-1 )/ULQ-6 

B-77 

C/S44 

ADC7 

ROTOVAC  6X,  ROTOVAC  7X 

B-28 

C/S45 

FC2 

Mk  86  Mod  0 

B-88 

C/S46 

EDC1-1 

AN/SPS-52 

B-58 

C/S47 

FC4-1 

AN/SPG-51B 

B-92 

C/S48 

FC2 

Mk  87 

B-88 

C/S50 

FC4-3 

M4-2 

B-96 

B-110 

B-173 


TABLE  B-4  Project  Index  (Continued) 
AREA 


PROJECT 

CODE 

SUBJECT 

_ £M£ 

C/S52 

EDC18 

AM-4 530/ ULQ-6A 

B-81 

C/S56 

ADC1-1 

AN/BQR-16 

B-12 

C/S59 

ADC1-2 

AN/BQR-15 

B-13 

C/S61 

ADC1-1 

AN/BQR-19 

B-12 

C/S63 

ADC5 

NIXIE 

B-26 

C/S68 

DD2 

DATACOURTS 

B-44 

C/S70 

EDC16 

AN/SLQ-1 7 (V ) 

B-78 

C/S71 

ADC8 

AN/WLR-9 

B-29 

C/S72 

EDC1-1 

AN/SPS-58 

B-58 

C/S82 

EDC2 

AN/UPX-24 

8-62 

C/S85 

ADC9 

SAWS 

B-30 

C/S94 

EDC5 

AN/WLR-8(V)2 

B-65 

C/VI 

Ml 

AIM-9C 

B-105 

C/V2 

ADC3 

B-23 

C/V9 

M2 

YAGM-45  SHRIKE 

B-106 

C/VIO 

ADC4 

SCAT 

B-25 

C/V14 

09 

Destructor  Mk  30  Mod  0 

B-136 

C/V22 

EDC1-3 

B-60 

F/096 

EDC7 

SHADOWGRAPH 

B-67 

F/0116 

DD7 

B-54 

F/0117 

DD3 

ASCAC 

B-48 

F/0134 

1003 

EXT 9,  EX20 

B-103 

F/0143 

I0D1 

B-100 

B-174 


TABLE  B-4  Project  Index  (Continued) 
AREA 


PROJECT 

CODE 

SUBJECT 

PAGE 

F/0145 

EDC19 

AN/ULQ-5 

B-82 

F/0148 

C3 

B-36 

F/0151 

EDC9 

B-69 

F/0186 

M3 

AGM-12B  Bull  pup 

B-108 

F/0198 

FC4-2 

F-4  AMCS  Aero  1A,  F-8  AW6-4 

B-92 

F/0210 

E0C17 

EDC20 

ALT-27 

B-80 

B-83 

F/0214 

A4-1 

5H-3A 

8-8 

F/0228 

DD4 

ANEW 

B-49 

F/0237 

FC4-3 

B-96 

F/0251 

SSI -3 

B-163 

F/0255 

A3 

B-6 

F/0257 

03 

A-6A/RABFAC/Paveway 

B-123 

F/0263 

02 

Walleye  II  Mk  5 

B-122 

0/S66 

C4 

AN/WRA-3 

B-37 

0/S97 

ADC6 

NAE  Beacon  Mk  3 Mod  1 

B-27 

0/S107 

C2 

B-35 

0/S108 

07 

SEANETTLE 

B-l  29 

0/S123 

EDC1-2 

AN/SPN-43 

B-59 

0/S126 

M4-1 

REDEYE 

B-l  09 

0/S1 38 

M4-2 

STANDARD  Missile 

B-l  10 

0/S145 

M4-1 

REDEYE 

B-l  09 

0/S150 

EDC14 

AN/BRD-7 

B-76 

B-175 


TABLE  8-4 

Project  Index  (Continued) 

PROJECT 

AREA 

CODE 

SUBJECT 

PAGE 

O/SI 53 

ADC1-4 

AN/SQQ-16 

8-18 

O/SI 55 

NG2 

AN/URN-20 

B-116 

O/SI 63 

edcm 

AN/SLQ-27 (XN-1 ) SHORTSTOP 

8-71 

O/SI 65 

I0D2 

B-102 

O/SI 67 

08-1 

Mk  48  Mod  1 

B-131 

O/SI 70 

NG3 

AN/BRN-7  OMEGA  Receiver 

B-117 

0/S178 

E0C4 

L Mk  3X  Mod  0 Locator  (RADRAG) 

B-G4 

O/SI 79 

006 

TIDY 

3-52 

O/SI 81 

Cl 

AN/WSC-3 

D-53 

0/S200 

EDC13 

AN/SRD-1 9( XN-1 ) 

B-75 

0/V28 

01 

Mk  15  Mod  0 SADEYE 

B-120 

0/V28E08 

FC1 

B-85 

0/V37 

04 

Mk  4 Mod  0 

B-124 

0/V42 

ADC3 

AN/SSQ-1 

B-23 

0/V52 

02 

Walleye  Mk  1 Mod  0 

B-122 

G/V71 

E0C6 

Mk  105  Mod  0,  Mk  104  Mod  1 

B-66 

0/V84 

A0C2 

CASS 

B-21 

0/V86 

05 

ZAP 

B-125 

0/V95 

04 

GPU-2/A 

B-124 

0/V98 

01 

CBU-59/B  APAM 

B-120 

0P/S480/S67 

DD5 

B-51 

0P/V126/J15-6 

EDC10 

AN/ASQ-8 

B-70 

0P/V218/J15-11 

ADC3 

AN/SSQ-20 

B-23 

0P/V261/H 

NG4 

AN/APN-126 

B-11C 

B-176 


TABLE  B-4  Project  Index  (Continued) 


AREA 


PROJECT 

COOE 

SUBJECT 

PAGE 

0P/V264/VV 

A1 

F8U-2 

B-3 

P/C2 

SS2 

LPH-2  Sea  Control  Ship 

B-166 

P/SI 

ADC1-3 

AN/SQO-23 

B-14 

P/S3 

EDC2 

AN/SLQ-20 

B-62 

P/V3 

A2 

S-26 

B-4 

P/V4 

A4-2 

SH-3H 

B-9 

X/C8 

C6 

B-39 

X/S7 

C7 

CVAN  68  (MPDS/FCS) 

B-40 

X/V17 

EOC3 

AN/ ASX-2  (TRISAT) 

B-63 

